CHARACTERIZATION OF STATIONARY DISTRIBUTIONS OF 

REFLECTED DIFFUSIONS 



WEINING KANG AND KAVITA RAMANAN 

Abstract. Given a domain G, a reflection vector field d(-) on dG, the boundary of 
G, and drift and dispersion coefficients &(•) and er(-), let £ be the usual second-order 
elliptic operator associated with b(-) and cr(-). Under suitable assumptions that, in 
particular, ensure that the associated submartingale problem is well posed, it is shown 
that a probability measure n on G is a stationary distribution for the corresponding 
reflected diffusion if and only if ir(dG) = and 

Cf(x)ir(dx) < 

f G 

for every / in a certain class of test functions. Moreover, the assumptions are shown 
to be satisfied by a large class of reflected diffusions in piecewise smooth multi- 
dimensional domains with possibly oblique reflection. 



1. Introduction 

1.1. Description of Main Results. The main focus of this work is to provide a 
simple characterization of stationary distributions of a broad class of reflected diffusions. 
Consider a domain G C M J , equipped with a vector field d(-) on the boundary dG, and 
drift and dispersion coefficients b : G h-» ~R j and a : G \- > R J x R , where G is the 
closure of G. A reflected diffusion associated with (G,d(-)), b(-) and cr(-) is, roughly 
speaking, a continuous Markov process that behaves locally like a diffusion with state- 
dependent drift b(x) and dispersion a(x), for x in G, and is instantaneously constrained 
to stay inside G by a pushing term that is only allowed to act when the process is on 
the boundary, and then only along the directions specified by the vector field d(-) 
at that point on the boundary. One approach to making this heuristic description 
precise is the so-called submartingale problem of Stroock and Varadhan [45J, which is 
a generalization of the martingale problem that was introduced to characterize the law 
of reflected diffusions in smooth domains. A submartingale problem is said to be well 
posed if it has a unique solution, and this implies existence and uniqueness in law of 
the associated reflected diffusion. A precise formulation of the submartingale problem 
in multi-dimensional domains is given in Section [2J The relation of this formulation to 
stochastic differential equation characterizations of reflected diffusions can be found in 
[291. 
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For reflected diffusions in a bounded domain, the family of time-averaged occupation 
measures is automatically tight, and the existence of a stationary distribution can 
be deduced as a simple consequence. On the other hand, for reflected diffusions in 
unbounded domains suitable conditions on the drift and reflection vector field need to 
be imposed to guarantee positive recurrence (see, e.g., pQ for sufficient conditions and 
also [4j, which shows that the issue of stability can be quite subtle in the presence of 
oblique reflection). In either case, when the diffusion coefficient is uniformly elliptic, 
uniqueness of the stationary distribution follows from standard results in ergodic theory. 
The focus of the present paper is on characterization of the stationary distribution. 

Given continuous drift and dispersion coefficients b : G h- )■ M J and a : G i— > ^ JxN , let 
a : G \— > R^ x ^ be the associated diffusion coefficient given by a(-) = a(-)a T (■), where 
<r T (x) denotes the transpose of the matrix a(x), and let C be the usual associated 
second-order differential operator 



where C%(G) is the space of twice continuously differentiable functions on G that, along 
with their first and second partial derivatives, are bounded. The first main result of 
this paper, Theorem [H shows that under suitable conditions (see Assumptions Q] and 
[2]), a probability measure ir on G is a stationary distribution for a reflected diffusion 
defined by a well posed submartingale problem if and only if it satisfies n{dG) = and 



for all / belonging to H, the class of test functions defined in ([6]). The second result, 
Theorem [2j shows that the conditions of Theorem [1] are satisfied by a large class of 
reflected diffusions in piecewise smooth domains described in Definition 13.21 which in- 
cludes a family of (possibly non-semimartingale) reflected Brownian motions (RBM) in 
convex polyhedral domains with piecewise constant vector fields that arise in applica- 
tions. Illustrative examples of such reflected diffusions are provided in Section [H where 
it is additionally shown that the conditions of Theorem [1] are also satisfied by some 
processes outside this class, including reflected diffusions in two-dimensional domains 
with cusps. 

If the stationary distribution tt of a reflected diffusion can be shown to have a density 
p that is sufficiently regular, standard arguments can be used to show that p should 
be the solution to a certain partial differential equation governed by the adjoint C* 
of C, and subject to certain oblique derivative boundary conditions. In non-smooth 
domains, such regularity properties are not always satisfied and, even when satisfied, 
are typically hard to establish a priori. Nevertheless, in some cases it is possible to 
write down the formal adjoint partial differential equation and boundary conditions and 
find an explicit solution to it (see, e.g., [22], [31], [12]). In such situations, it would 
be useful to have a result that guarantees that this solution is indeed the stationary 
distribution of the reflected diffusion. Using Theorem [H it is shown in Corollary 13.41 
that any nonnegative integrable solution of the adjoint partial differential equation, 
when suitably normalized, is indeed a stationary density of the reflected diffusion. 




(2) 
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1.2. Motivation and Prior Work. Our results can be viewed as a generalization of 
Echeverria's results [17] for diffusions in M. J to the case of reflected diffusions. Given 
sufficiently regular drift and dispersion coefficients &(•) and cr(-), Echeverria |17j showed 
that a probability measure tt is a stationary distribution for the associated diffusion in 
H J characterized by the corresponding martingale problem if and only if ([2]) holds with 
inequality replaced by equality and for test functions / G C^(M J ), the space of twice 
continuously differentiable functions on R* 7 with compact support. An extension of this 
result to reflected diffusions in C 2 -domains was considered by Weiss in his unpublished 
Ph.D. thesis [49J. However, the results of [49J do not apply to reflected diffusions 
in non-smooth domains in R" 7 . Such reflected diffusions arise in many fields including 
finance [5] , economics [39J , communications [37] and operations research [24] , and it is of 
interest to characterize their stationary distributions. For the particular case of reflected 
Brownian motion (RBMs) in convex polyhedral domains, explicit expressions for the 
stationary distribution have been established only in some two-dimensional examples 
[7], |22j . |51| . or when a certain skew-symmetry condition holds [52], in which case the 
stationary distribution has a density that is the product of its marginals. In other cases, 
numerical schemes have been proposed for the computation of stationary distributions 
(see, e.g., [TO] and [12]). The characterization of the stationary distribution established 
in this paper could be used to provide a rigorous justification for these numerical 
schemes. For reflected Brownian motions (RBMs) in convex polyhedrons that are 
semimartingales, there has been some work on establishing the basic adjoint relationship 
using so-called constrained martingale problems in the unpublished manuscript |llj . 
In this paper, we establish a different characterization by a different method of proof 
and deal with the more general setting of curved, non-smooth domains, and reflected 
diffusions (with state dependent coefficients) that are not necessarily semimartingales, 
both of which arise in applications (see, e.g., [271 Section 5.6] and [28 1 136 | 137 ] |3"5]). 

1.3. Outline of the Paper. Section [2] contains a precise definition of the submartin- 
gale problem and the associated class of reflected diffusions. In Section [3] the main 
results of the paper, Theorem [H Theorem [2] and Corollary 13.41 are stated. The proof 
of Corollary 13.41 is given in Section [3j whereas the proofs of Theorem [1] and Theorem 
[2] are deferred to Section [5] and Section [61 respectively. Section d] contains illustrative 
examples of reflected diffusions for which the stationary distribution characterization 
established in this paper is valid. The proofs of some technical lemmas are relegated to 
the Appendix. First, in the next section, we summarize some common notation used 
in the paper. 

1.4. Notation and Terminology. The following notation is used throughout the 
paper. Z is the set of integers, N is the set of positive integers, R is the set of real 
numbers, Z + is the set of non-negative integers and R+ the set of non-negative real 
numbers. For each J G N, R" 7 is the J-dimensional Euclidean space and | • | and 
(-,-), respectively, denote the Euclidean norm and the inner product on R^. For each 
vector v G R" 7 and matrix a G R" 7 x R^, v T and a T denote the transpose of v and a, 
respectively. For each set A C R^, A° , dA and A denote the interior, boundary and 
closure of A, respectively. For each x G R" 7 and A C R" 7 , dist(x, ^4) is the distance 
from x to A (that is, dist(x,^4) = inf{y G A : \y — x\}). For each A C R" 7 and r > 0, 
B r (A) = {y G R J : dist(y, A) < r}, and given e > let A £ = {y G R J : dist(y, A) < e} 
denote the (open) e-fattening of A. If A = {x}, we simply denote B r (A) by B r (x). We 
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also let 1b denote the indicator function of the set B (that is, = 1 if x G B and 

1b (x) = otherwise). 

Given a domain I? in R n , for some n G N, and any m G Z + U {oo}, let C m {E) 
be the space of real-valued functions that are continuous and m times continuously 
differentiable on E with partial derivatives of order up to and including m. Also, 
let C™(E) be the subspace of C m (E) consisting of bounded functions whose partial 
derivatives of order up to and including m are also bounded, let C™(E) be the subspace 
of C m (E) consisting of functions that vanish outside compact sets, and let C™(E) be 
the subspace of C m (E) consisting of functions / that vanish at infinity. In addition, let 
C™(E)(BM. be the direct sum of C™(E) and the space of constant functions, that is, the 
space of functions that are sums of functions in Cl n (E) and constants in R. Likewise, let 
C™(E) © R be the space of functions that are sums of functions in C™{E) and constants 
in R. If m = 0, we denote C m (E), C^(E), C™(E), C^(E) , C™(E) © R and C^(E) ©R 
simply by C(E), C b (E), C C (E), C (E), C C (E) ©R, and C (E)®R, respectively. When E 
is the closure of a domain, C m (E) is to be interpreted as the collection of functions in 
D £> oC m (E £ ), where E £ is an open e-neighborhood of E, restricted to E. The support 
of a function / is denoted by supp(/) and the gradient of / is denoted by V/. 

The space of continuous functions on [0, oo) that take values in R J is denoted by 
C [0, oo), the Borel cr-algebra of C [0, oo) is denoted by A4, and the natural filtration on 
C [0, oo) is denoted by {Ait}- The Borel cr-algebra of G is denoted by B(G). 

2. A Class of Reflected Diffusions 

In this section we introduce the class of reflected diffusions that we consider. Let G 
be a nonempty connected domain in R" 7 , and let d(-) be a set-valued mapping defined on 
G, such that each d(x), x G dG, is a non-empty closed convex cone in R J with vertex at 
the origin 0, d(x) = {0} for each x in G°, and the graph of d(-) is closed, that is, the set 
{(x, v) : x G G, v G d(x)} is a closed subset of R 2J . Let V be a subset of dG. As shown 
in Section [H V will typically be a (possibly empty) subset of the non-smooth parts of 
the boundary of the domain G where d(-) is not sufficiently well behaved. For each 
function / defined on R J , we say / is constant in a neighborhood of V if for each x G V, 
/ is constant in some open neighborhood of x. Given measurable drift and dispersion 
coefficients b : R J H- R J and a : R J ^ R J x R N , and a = aa T : R J H> R J x R J , let 
C be the associated differential operator defined in ([1]). One way of characterizing a 
reflected diffusion is through the so-called submartingale problem. 

Definition 2.1. (Submartingale Problem) A family {Q 2 , z G G} of probability measures 
on (C [0, oo) , A4) is a solution to the submartingale problem associated with (G,d(-)), 
V , drift b{ ) and dispersion &{■) if for each A G M., the mapping z h-» Q z {A) is B(G)- 
measurable and for each z G G, Q z satisfies the following three properties: 

1. Q,(w(0) = z) = 1; 

2. For every t G [0, oo) and f G C^(R J ) such that f is constant in a neighborhood 
ofV and (d,Vf(x)) > for all d G d(x) and x G dG, the process 

(3) /("(*))- /* Cf(co(u))du, t>0, 

Jo 

is a Q z - submartingale on (C [0,oo) , A4,{Mt}); 
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3. For every z G G, 



o 



lv(w(s)) 



0. 



In this case, Q z is said to be a solution to the submartingale problem starting from z. 
Moreover, given a probability distribution it on G, the probability measure Q n , defined 
by 



(4) Qn(A)= _Q z (A)ir(dz), for every A e M, 

Jg 

is said to be a solution to the submartingale problem with initial distribution tt. 



The submartingale problem is a generalization of the martingale problem that was 
first introduced in [36] to characterize the law of reflected diffusions in smooth do- 
mains. Extensions of the submartingale problem to characterize reflected Brownian 
motions in non-smooth domains were considered in previous works such as [15] for 
two-dimensional wedges and [52J and [35J for certain convex polyhedral domains. Def- 
inition 12. f I generalizes these formulations further to accommodate a more general class 
of multi-dimensional reflected diffusions. The first condition in Definition 12. f I simply 
states that the family of measures is parameterized by the initial condition. The second 
condition in Definition 12 . f I captures the notion of diffusive behavior in the interior, and 
reflection along the appropriate directions on the boundary. Since the "test functions" 
in property 2 are constant in a neighbourhood of V, this condition does not provide 
information on the behavior of the diffusion in a neighborhood of V. The third con- 
dition is imposed to ensure instantaneous reflection on the boundary (precluding the 
possibility of absorption or partial reflection at the boundary). The set V is typically a 
subset of the non-smooth parts of the boundary. In many cases, there is some flexibility 
in the choice of V, with several choices yielding equivalent characterizations that are all 
compatible with the stochastic differential equation (with reflection) formulation. As 
described in Remark 13.31 there is a canonical choice for V that is suitable for all the 
considered examples. It is typically harder to establish uniqueness, rather than exis- 
tence, of solutions to the submartingale problem. In many cases, it is easier to establish 
uniqueness, and therefore, well-posedness of the submartingale problem (see Definition 
12.21 below) when the set V is smaller. For further discussion on the formulation of the 
submartingale problem in the non-smooth setting, see [29] . 

Definition 2.2. The submartingale problem associated with (G,d(-)), V, drift b{-) and 
dispersion cr(-) is said to be well posed if there exists exactly one solution to the sub- 
martingale problem. 

We will only consider submartingale problems that are well posed. In addition, we 
will also assume throughout, without explicit mention, that the drift and diffusion 
coefficients are continuous. Under this assumption, for every / G C^(R J ), the mapping 
x \— > Cf{x) is continuous, and so the integral in ([3]) is clearly well defined. 

We now consider reflected diffusions associated to the submartingale problem. 

Definition 2.3. A stochastic process Z defined on a probability space (Q, J-, P) is said 
to be a reflected diffusion associated with (G,d(-)), V, drift b(-) and dispersion a(-) if 
its family of distribution laws {Q z , z G G} is the unique solution to the submartingale 
problem, where Q z , z G G, is the conditional distribution of Z under P, conditioned on 
Z(0) = z. 
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Reflected diffusions are sometimes also defined in terms of weak or strong solutions to 
stochastic differential equations using the Skorokhod problem or extended Skorokhod 
problem. The relationship between this formulation and the submartingale problem 
characterization is studied in |29j . In particular, it is shown that weak solutions to a 
large class of stochastic differential equations in piecewise smooth domains are associ- 
ated with well posed submartingale problems. 

For our subsequent analysis, it will be convenient to also consider a localized version 
of the submartingale problem. For each r > 0, consider the stopping time 

(5) x r = inf{t > : |w(t)| > r}, u G C [0, oo) . 

Definition 2.4. (Localized Submartingale Problem) Fix r > 0. A family {Q r z ,z G G} 
of probability measures on (C [0, oo) ,A4) is a solution to the submartingale problem 
associated with (G, d(-)), V, drift b(-) and dispersion a(-) that is stopped at the time \ r 
if for each A G Ai, the map z i— )■ Q^(A) is B(G) -measurable and for each z G G, 
satisfies the following three properties: 

1. QXO) = z) = 1; 

2. For every t G [0,oo) and f G C^R- 7 ) such that f is constant in a neighborhood 
of V and (d, V/(x)) > for all d G d(x) and x G dG, the process 

rt/\x r 

f(Lo(tA X r ))- / Cf(u(u))du, t>0, 

JO 

zs a Q£- submartingale on (C [0, oo) , A^,{A^t}); 

3. For e« ery z £ G, 

E / l v (a;(s))ds 
o 



0. 



In i/iis case, * s sa *^ ^° ^ e a solution to the submartingale problem starting from z 
that is stopped at the time x r ■ Moreover, given a probability distribution tt and G, the 
probability measure defined as in Q), but with Q replaced by Q r ; is said to be a 
solution to the submartingale problem stopped at x r with initial distribution tt. 

Remark 2.5. When the submartingale problem associated with (G,d(-)), V, drift b(-) 
and dispersion cr(-) is well posed, for each r > 0, the submartingale problem stopped 
at the stopping time x r is a l so wen posed. This can be justified by using an argument 
similar to the one used in the proof of Theorem 6.1.2 of [46J. 

3. Main Results 

The primary goal of this work is to provide a useful characterization of the stationary 
distributions of a broad class of reflected diffusions. 

Definition 3.1. A probability measure tt on G is a stationary distribution for the 
unique solution {Q z ,z G G} to a well posed submartingale problem if tt satisfies the 
property that the law of oj(t) under is tt for each t > 0. In this case, tt is also said 
to be a stationary distribution of any reflected diffusion associated with the well posed 
submartingale problem. 

The main result of this paper is a necessary and sufficient condition for a probability 
measure tt to be a stationary distribution for the well posed submartingale problem. In 
what follows, recall that C^(G) ©M is the space of functions that are sums of functions 
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in Cc(G) and constants in R, and that V/ denotes the gradient of a function / on a 
domain in M J . Given a subset V C dG, let % = 7~Lv be the set of functions 

, s ( f G C 2 C (G) R : /is constant in a neighborhood of V, [ 

W \ (d, V/(y)) < for d G e%) and y G <9G J ' 

It is easy to see that if the unique solution {Q z , z G G} to a well posed submartingale 
problem associated with (G,d(-)) and V admits a stationary distribution tt, then tt 
must satisfy the inequality (J2J for all / such that — / G %, where C is the operator 
defined in (fT]). Indeed, it follows from the second property in Definition 12.11 that for 
each / with — / G H, 

ft 



f{u{t))- / Cf{u(u))du 







> E®« [/( W (0))] . 



Since E Q7r [f(uj(t))} = E Qir [f(u(0))} due to the stationarity of tt, this establishes the 
inequality in ([2]) for all functions / with — / G We will show that, under two assump- 
tions stated below, the later condition is also sufficient for any probability measure tt 
with tt(8G) = to be a stationary distribution of {Q 2 , z G G}. 

The first assumption is the existence of a family of test functions, which is used in 
Section [573] to establish the tightness of a certain sequence of approximating probability 
measures. 

Assumption 1. For each e > and N G N, there exists a family of nonnegative 
functions {f XjS G C%(G), x G G C~) B N (0)} and constants C(N,e) > and c(N,e) > 
such that the following three properties hold: 

1- fx,s is a finite or countable sum of functions in H nC^(G); 

2. For eachy G G, f X)£ (y) = if\y-x\ < e/2, and f x>e (y) > c(N,e) if\y-x\ > 3e; 

3. \£f x ,s(y)\ < C(N,e) for each y G G. 

The second assumption concerns the geometry of the set V. 

Assumption 2. The set V is finite and for each x G V, there exist a unit vector 
v x ^ and positive constants a x ,r x such that (v x ,y — x) > a x \y — x\, v x a(y)v x > a x 
and (v x ,d) > for all d G d{y) and all y G G H B Tx (x). 

We now state the first main result of this paper. Its proof is given in Section[5l Recall 
that we assume throughout that the drift and diffusion coefficients are continuous. 

Theorem 1. Suppose we are given (G,d(-)), b(-), cr(-) and V such that the associated 
submartingale problem is well posed and Assumptions^ and[M are satisfied. Let tt be a 
probability measure on (G,B(G)) with Tr(dG) = 0. Then tt satisfies the inequality p|) 
for all —f G H if and only if tt is a stationary distribution for the unique solution to 
the associated submartingale problem. 

The necessity of the condition stated in Theorem [1] is, as shown above, straightfor- 
ward. On the other hand, the proof of sufficiency, which is given in Section entails 
first constructing a suitable sequence of Markov chains with stationary distribution 
tt and then showing that the sequence converges to a solution of the submartingale 
problem. Both steps are more involved when the domain is not smooth, in part due to 
the difficulty of estimating the amount of time the reflected diffusion spends near the 
boundary, especially in the neighborhood of the set V C dG. 
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We now introduce a broad class of data (G,d(-)) and V for which the stationary 
distribution characterization obtained in Theorem [T] applies. 

Definition 3.2. The pair (G, d(-)) is said to be piecewise C 1 with continuous reflection 
if G and d(-) satisfy the following properties: 

1. The domain G is a non-empty domain with representation G = fliex^i> where 
Z is a finite index set and for each i G X, G{ is a non-empty domain with C 1 
boundary, that is, there exists a continuously differ entiable function <f) 1 on M J 
such that 

Gi = {x: ^(x) > 0} and dG { = {x : tp(x) = 0}. 
Let n l {x) denote the unit inward normal vector to dGi at x G dGi and define 

I{x) = {i € J : x G dGi}, 
and for each x G dG, let 

n(x) = < s i n% { x )i Si >0,i ^ T(x) 

2. The direction vector field d(-) is given by 

d(x) = < ^ SiY(x), Si>0,ie l(x) > , x G dG, 
\iex{x) ) 

where for each i G T, 7*(-) is a continuous vector field associated with Gi such 
that (n l (x), 7*(x)) > for each x G dGi. 

If, in addition, n l {-) is constant (so that the domain G is a polyhedron) and 7*(-) is 
also constant, then the pair (G, d(-)) will be said to be polyhedral with piecewise constant 
reflection. 

Given (G,d(-)) that is piecewise C 1 with continuous reflection, we can assume, with- 
out loss of generality that for each i G X, 

(7) (ri l (x),'y i (x)) = 1, for each x G dGi. 

In the analysis of reflected diffusions in non-smooth domains, a special role is played 
by the following set on the boundary: 

(8) U = {xedG:3n€ n{x) such that (n, d) > 0, Vd G d(x) \ {0}}. 

Assumption 2'. V is a finite set such that V D dG\U, and for each x G V, there exist 
a unit vector v x , constants r x > 0, a x > and 0<c^,<l<c^<oo such that for all 
y G GnB Tx (x), the following properties are satisfied with Q x = {z G M. J : (z, v x ) > 0}: 

(1) (v x ,y- x) > a x \y - x\; 

(2) i l {y) G Q x for each i G Z(y) C X(x); 

(3) for every r G (0, r x /c%,), 

(9) G n B c i r (x) C {y G G n B rx (x) : dist(y, x + rv x + Q x ) > 0} 

c Gn%(4 

(4) yTa(y)v x > a x for all y G S ra; (a;); 
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Remark 3.3. Note that Assumption 2' is trivially satisfied when dG = U, and V = 0. 
The condition that dG = U ensures that at each x G dG there exists a normal vector 
n G n(x) that makes a strictly positive inner product with all unit reflection vectors 
d G d{x). It can be viewed as a generalization of what is known in the literature as 
the completely-iS condition. A canonical choice is to define V to be equal to the set of 
points on dG at which this condition fails to hold. In the context of certain polyhedral 
domains with piecewise constant reflection fields, the stipulation that the completely-5 
condition hold has been shown to be necessary and sufficient for the associated reflected 
diffusion to be a semimartingale [351 [40l I47j . However, in this work we also allow for 
cases when dG ^ U, thus providing a characterization of the stationary distribution 
for reflected diffusions that are not necessarily semimartingales |21| [28| [35] . 

We now state the second main result of this paper, whose proof is given in Section 

El 

Theorem 2. Suppose that either (G, d(-)) is piecewise C 1 with continuous reflection and 
G is bounded, or (G, is polyhedral with piecewise constant reflection. If Assump- 
tion 2' is satisfied and the drift and dispersion coefficients b(-) and a(-) are uniformly 
bounded, then (G,d(-)) andV satisfy Assumptions^ andlM 

As an immediate consequence we see that Theorem Q] can be used to characterize the 
stationary distributions of reflected diffusions that satisfy the conditions of Theorem [2] 
and are associated with well-posed submartingale problems. As shown in Section [H this 
includes many classes of reflected diffusions that arise in applications. But Theorem Q] 
is also applicable to reflected diffusions outside the class described by Theorem [2j An 
illustrative example is given in Example 14.51 of Section 01 

To state the last main result of this paper, we introduce C* , the adjoint operator to 
C: for p G C 2 (G), 

1 3 d 2 3 d 

£*p(x) = 2 Yl dxidx^ aij ^ p ^ ~ ^ -fa.( bi ^p( x V- 

i,j=l % ^ i=l * 

We now show that nonnegative and integrable solutions of the so-called basic adjoint 
relation (BAR) are indeed stationary distributions for the submartingale problem. In 
what follows, let S denote the smooth parts of the boundary dG. 

Corollary 3.4. Suppose that the pair (G,d(-)) is piecewise C 1 with continuous re- 
flection, (0) is satisfied, V C dG satisfies Assumption 2' and bi(-), aij(-) G C 2 (G) 
for i,j = 1,...,J, and the submartingale problem associated with (G,d(-)) and V is 
well posed. Furthermore, suppose there exists a non-negative function p G C 2 (G) that 
satisfies j-^p{x)dx < oo and the following partial differential equation with boundary 
conditions: 

1. C*p(x) = for x G G; 

2. for each i G X and x G dG L D S, 



-2p(x) (n l (x),b(x)) + (n l (x)) T a(x)Vp(x) +p(x)Ki(x) 

-V- (p(x){n l (x)) T a{x)n l (x)~i l {x) - p{x)a(x)n l {x)) = 0, 
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J 



*(,) - ( „'(.),£ ^ } = E "tw E If 4 w: 

\ i= l J / fc=l j= l ax J 

3. /or eac/i i,jeX,i^ j and x G SGj n 9Gj n <9G \ V, 

[(n^x), (n 1 (x)) T a(x)n l (x)j l (x) — a(x)n l (x)} 
+ (n l (x), (n? (x)) T a(x)n? (x)y> (x) — a{x)n^ (x))) = 0. 
Then the probability measure on G defined by 

(10) ^) = f44?' AeB(U), 

JcP{x)dx 

is a stationary distribution for the well posed submartingale problem. 

Proof. By Theorems [T] and [21 it suffices to show that the probability measure tt defined 
in terms of p via (|10p satisfies the inequality ([2]) for all functions / such that — / E 
% Pi Cc(G). For any such function /, straightforward calculations show that for each 
x £G, 

p(x)Cf(x) - f{x)C*p{x) = iv • H{x), 
where H = H* is the vector field such that its ith component is given by 



H i( x ) = Z2 \P( X ) a ij( X )-a—. f( x ) a ij( x )-K— ~ f( x )p( x ) 



3=1 



dajj (x) 

dxj J y ' ljy ' dxj J y ' dxj 
+2bi{x)f(x)p(x). 
Since C*p(x) = for x £ G, the Divergence Theorem implies that 

(11) / Cf{x)p{x)dx = 7: / (n(x), H(x))[i(dx) 

J~G 2 J dG 

= -?E / (n\x),H(x))d^(x), 
iex J 9G indG 

where n(-) is the outward pointing unit normal field on dG, /i(dx) is the surface measure 
on dG, and Hiidx) is the surface measure on dG D dGi for each i S X. Note that for 
each i £ I and x € <9G n <9Gj , 

(n i (x),H(x)) = p{x)(n i (x)) T a{x)Vf(x) - f(x)(n i (x)) T a(x)Vp{x) 

-f{x)p{x)K,i(x) + 2f(x)p(x) {n\x),b(x)) . 

Combining the above display, (jlip and condition 2 in the theorem, we obtain 

Cf(x)p(x)dx 

/ p(x)(n i (x)) T a(a;)V/(a;)d/ii(a;) 

+ / " (p(2;)(n l (x)) T a(x)n 4 (x)7 4 (x) - p(x)a(x)n l (x))dfii(x). 



■iex 



ddndG 
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Note that for each i 6 X and x € dGi D dG, 

V • (/(x)p(x)[(n*(x)) T a(x)n*(x)7 J (x) - a[x)n l {x)]) 
= /(x)V • {p{x)[(n l {x)) T a(x)n l (x)^ 1 {x) — a(x)n l {x)\) 

+ {Y(x),Vf{x))p(x)(n l (x)) T a(x)n i (x) - p(x)(Vf(x)) T a{x)n i (x). 

It follows from the last two equalities that 
£f(x)p(x)dx 



G 

^ V • (f (x)p(x)((n l (x)) T a(x)n l (x)rf (x) — a{x)n l (x)))d/j,i(x) 



2 ^ 



2 ^ 



(7 J (x), V/(x))p(x)(ra 4 (x)) a(x)n l (x)d^i(x). 
dGiDdG 



The second term on the right-hand side of the above equality is non-positive since 
— / G %, p > and a is positive semidefinite. So, we shall focus on the first 
term on the right-hand side of the above display. Now, for each x G dGi n dG, 
(n*(x), (n*(x)) T a(x)n*(x)7 l (x) — a(x)n*(x))) = because of the assumed normaliza- 
tion (n l (x), 7*(x)) = 1- Therefore, the vector (n l (x)) T a(x)n' 1 (x)j 1 (x) — a(x)n l (x) is 
parallel to dGi at x, and the divergence in the first term on the right-hand side of 
the above display is equal to the divergence taken in the (J — l)-dimensional manifold 
dGi H dG. Another application of the Divergence Theorem then yields 



V / V • (f(x)p{x)((n i (x)) T a{x)n i (x)f{x) - a{x)n i (x)))dm(x) 

7^ JdG.ndG 

/ f(x)p(x) (n JJ (x), (n*(x)) T a(x)n l (x)7*(x) - a(x)n*(x)) dfiij(x), 



FiAV 



where i^j = <9Gj n dGj n <9G, n* J (x) denotes the unit vector that is normal to both F$j 
and n l (x) at x and points into <9Gj D S from i^j , and /Uy (dx) is the surface measure on 
the (J — 2)-dimensional manifold Fij. To prove the theorem, it suffices to show that 
the last equality in the above display is zero. To do this, it suffices to show that for 
each i,j E Z with i ^ j and x S Fij \ V, 

(12) p{x) {(n ij (x), (n i (x)) T a{x)n i (x)f{x) - a(x)n i (x)> 

+ (n^^x), {p? \x)) T a{x)nP {x)^ {x) — a(x)n- J (x))) = 0. 

Since n* J (x) is normal to dGi H <9Gj at x S dGi H <9Gj , it must lie in the two dimensional 
space spanned by n l (x) and n 3 {x). In addition, n i:i (x) is a unit vector normal to n l (x) 
and points into dGi from <9Gj n dGj. Then we have 

n ij {x) = (n j (x) - {n i {x),n\x))n i (x))/{l - (n^x), n^'(x)) 2 ) 1 / 2 

and 

nF(x) = {n\x) - (n i (x),n j (x))n 3 {x))/{l - {n\x), n\x)) 2 ) 1 / 2 . 

With the above two representations, we see that (I12|) is equivalent to condition (3) in 
the theorem. This yields the desired result. □ 
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4. Examples 

In this section, we provide several examples of reflected diffusions in general domains 
for which the submartingale problem is well posed and Assumptions [T] and [2] are sat- 
isfied, so that Theorem Q] provides a characterization of their stationary distributions. 
The examples serve to illustrate the range of applicability of the main result of the pa- 
per. In the first three examples, the reflected diffusions are semimartingales, whereas 
in the last two examples they fail to be semimartingales, two of the examples deal 
with curved domains and three of the examples are multi-dimensional. For simplicity, 
in all cases we assume that b and a are continuous and uniformly bounded and that 
when V ^ 0, a is uniformly elliptic (although only the partial uniform ellipticity in the 
direction v x of Assumption [2] is actually required) . 

We start with the simple case of smooth domains. 

Example 4.1. Let G be a bounded open set in W J such that G = {x G M" 7 : <p(x) > 0}, 
where cf> G C 2 {U. J ) and |V0| > 1 on dG. Thus, X7(fi(x) is the inward normal vector 
at i 6 dG. Let 7(-) be a bounded Lipschitz continuous vector field that satisfies 
{V(/)(x),j(x)) > on dG, and let V = 0. Then it trivially follows that (G,d(-)) is a 
C 1 domain with continuous reflection and, since U = dG, Assumption 2' is trivially 
satisfied with V = 0. By [45] (see Theorems 3.1 and 5.4 therein) the associated sub- 
martingale problem is well posed. Moreover, since G is bounded, Theorem [2] shows 
that Assumptions [T] and [2] are satisfied (the latter holding trivially) . 

Example 4.2. Consider a two-dimensional wedge G given in polar coordinates by 

G = {(r,0) : < 9 < C, r > 0}, 

where £ G (0, ir) is the angle of the wedge. Then G admits the representation G = 
G% D C?2 j where G\ and G2 are the two half planes 

G\ = {(r,6) : < 9 < vr, r > 0}, 
G 2 = {(r,9) : ( - vr < 9 < £ r > 0}. 

Let the directions of reflection on dG\ and dG 2 be specified as constant vectors 7 1 and 
7 2 normalized such that for j = 1,2, (7^, vP) = 1. For j = 1,2, define the angle of 
reflection 9j to be the angle between n? and 7 J , such that 9j is positive if and only if 
7 J points towards the origin. Note that — tt/2 < 9j < tt/2. Define a = (9\ + ^)/C- It 
was proved in [48] that the submartingale problem is well posed when a < 2. 

Let V = {0}. For every a < 2, it is easily verified that U contains dG\ {0}, and so V 
satisfies the first property stated in Assumption 2'. In fact, when a < 1, U = dG and so 
there exists a positive combination no of n 1 and n 2 such that (n®,^) > for j = 1, 2. 
Since Q G (0, 7r), it is obvious that (tiq,x) > for each x G G. On the other hand, 
when a = 1, 7 and 7 2 are pointing towards each other. In this case, G lies on one side 
of the line through the vertex that is parallel to 7 1 and 7 2 . Let no be a unit vector 
perpendicular to the line that points into the half-space that contains G, that is, let 
(no, x) > for each x G G\{0}. In either case, let 0(0) = {y G M 2 : (no, y) > 0}. It can 
be verified that the properties of Assumption 2' hold with the choice of ro = 00, ao = 
inf{(n ,2;) : \x\ = l,x G G} > 0, = 1/2 and Cq = max{l/ sin(C + 6>i), 1/ sin(6>i)}. 
Thus, V = {0} satisfies Assumption 2'. Since {G, d{-)) is polyhedral with constant 
reflection, Assumptions [T] and [2] hold by Theorem [21 



STATIONARY DISTRIBUTION CHARACTERIZATION 



13 



Example 4.3. We now describe another class of RBMs in the orthant that arise as 
diffusion approximations of queueing networks |40j and of Leontief systems in econom- 
ics [39]. In this case, G = Ri is the non- negative orthant in M. J , which admits the 
representation G = P)i=i wnere Gi = {x £ R^ : X{ > 0}, and the direction vector 
field 7* on Gi is a constant vector field, pointing in a direction d 1 G R^. Moreover, 
the matrix D with column d 1 is assumed to satisfy the completely-5 condition, which 
implies that U = dG. Thus, by Remark 13. 3[ Assumption 2' is trivially satisfied with 
V = 0. In this case, it was shown in [47J that the stochastic differential equation with 
reflection associated with G and d(-) admits a weak solution that is unique in law. 
By Theorem 2 of [29] it then follows that the submartingale problem is well posed. 
Moreover, since (G,d(-)) is polyhedral, once again Theorem [2] shows that Assumptions 
[1] and [2] are satisfied. 

Example 4.4. Generalized processor sharing (GPS) is a service discipline used in 
high-speed networks that allows for efficient sharing of a single resource amongst traffic 
of different classes. It was shown in [131 [El [TBI [37] that the GPS discipline can be 
modelled in terms of an associated (extended) Skorokhod problem or, equivalently, a 
submartingale problem. We now introduce a class of RBMs that were shown in |37j 
and [38] to arise as reflected diffusion approximations of multiclass queueing networks 
using this scheduling discipline. The two-dimensional case also corresponds to the case 
a = 1 and 7r = 90° in Example 14.21 

The state space G associated with the GPS ESP has the representation 

J+i 

G= f]{x GR J : <x,n'> > 0}, 
i=l 

where n l = for i = 1, . . . , J (here {ej, i = 1, . . . , J} is the standard orthonormal basis 
in R J ) and nj + i = Yli=i e i/^J- The reflection vector field is piecewise constant on 
each face, governed by the vectors {7*, i = 1,..., J + 1} that are defined as follows: 
7 J+1 = Yli=i e i/"\/~J an d {t'j* = li--->J} are defined in terms of a "weight" vector 
a £ R^ that satisfies a, L > for each i = 1, J and Yli=i &i = 1 ; f° r hi = 1> ■ • • > J 1 

-^-r- for j f !, 
1 for j = z. 

It is easily verified that the generalized completely-5 condition is satisfied at all points 
in 9G\{0} (see Lemma 3.4 of |35j). Therefore, V = {0} satisfies the first property in As- 
sumption 2'. Moreover, note that d(0) = {x G R J : (x, dj + i) > 0}. Choose no = dj+i, 
ro = 00, ao = 1, Cq = 1, and Cq = V~J and G(0) = d(0). Then (rto,y) > co|y| for every 
y G G and Gfl -B c i r (0) C {y G G : dist(y, rn + 9(0)) > 0} C -B c 2 r (0) for each r > 0. 
Then V satisfies Assumption 2' and G,d(-) is polyhedral. Therefore, Theorem shows 
that Assumptions Q] and [2] hold. The fact that the associated stochastic differential 
equation with reflection has a pathwise unique solution follows from Corollary 4.4 of 
|35j . Hence, well-posedness of the submartingale problem follows from Theorem 2 of 
[29]. 

Example 4.5. Consider a two-dimensional domain G with representation 
G = {{x, y): x > 0, -x^ < y < x }, > 1. 
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The domain G has a cusp at the origin and G = G\ n G2, where 

G\ = {(x,y) : y < x 13 when x > and y < when x < 0}, 
Cr2 = {(x,y) : y > —x^ when x > and y > when x < 0}. 

For each j = 1,2 and 2 G ^Crj, let nP(z) be the inward unit normal vector to dGj 
and let ^(z) make a constant angle 6j G (— 7r/2,7r/2) with n^z). We take 0,- > if 
and only if the first component of 7 J (z) is negative, that is, 7 J (2) points towards the 
origin, in small neighborhoods of the origin. Since 9j 7^ ±tt/2, we can without loss of 
generality assume the normalization (7 3 (2),n 3 (;s)) = 1 holds. It was proved in [8] that 
the submartingale problem is well posed when 9\ + 62 < 0. 

With the choice V = {0}, it is clear that the first condition of Assumption 2' is 
satisfied. To see that the second set of properties is also satisfied, let no be a unit 
vector that is perpendicular to 7 1 (0) and points towards G, and as usual let 0(0) = 
{x G R 2 : (n ,x) > 0}. It is easy to see that j j (0) G 9(0) for j = 1,2 and that 
there exist ro > 0, a?o > 0, Cg > and Cq > such that (no,y) > ao\y\ for every 
y G GnB ro (0) and Gfl B c i r (0) C {y G 5nB ro (0) : dist(y, rn + 6(0)) > 0} C 5 c 2 r (0) 
for each r G (0, tq/2). Thus, (G,d(-)) is clearly piecewise C 1 with continuous reflection 
and V satisfies Assumption 2', which immediately implies Assumption [2] is satisfied. 
Since G is neither bounded nor a polyhedral domain, Theorem [2] cannot be applied 
directly to show that Assumption [1] holds. But a similar argument as the one used in 
the proof of Theorem [2] can be used to establish Assumption [TJ The details are deferred 
to Appendix [Bj 

5. Proof of Theorem CD 

Let 7r be a probability measure on (G,B(G)) such that Tr(dG) = 0. The discussion 
prior to the statement of Theorem Q] shows that ((2]) is a necessary condition for n to be 
a stationary distribution of the submartingale problem. So, it only remains to prove the 
sufficiency of the condition ([2]). For the remainder of this section we assume that tt has 
the additional property that it satisfies ([2]) for every — / G H, and prove that then tt is 
a stationary distribution for the well posed submartingale problem. The proof consists 
of two main steps. In the first step, which is carried out in Section 15.11 a sequence of 
discrete time Markov chains is constructed such that it is the stationary distribution 
for each Markov chain in the sequence. In the second step, which is presented in 
Sections I5.2H5.44 it is first shown that the sequence of continuous time extensions of 
the Markov chains converges to the unique solution of the submartingale problem with 
initial distribution tt. The fact that tt is a stationary distribution for each Markov chain 
in the approximating sequence is then used to deduce that tt is a stationary distribution 
for the submartingale problem. 

5.1. Construction of Markov Chains. In what follows, let T~L be the class of func- 
tions defined in ([6]) and let A > be a given constant. We shall construct a discrete 
time Markov chain {X x (n\), n G Z + } that has tt as its stationary distribution and 
satisfies an inequality that is analogous to property 2 of the submartingale problem. 

We first state a preliminary lemma. This lemma is similar to Lemma 3 of [49], 
but the class of functions T~L considered here also takes into account the set V. For 
completeness, we provide the proof of the lemma in Appendix O 
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Lemma 5.1. Given n G N and fi G %, i = 1, ■ ■ ■ ,n, for each concave function 
ip G C 2 (R n ) i/iai is monotone increasing in each variable separately, and any X > 0, we 
have 



Lemma 5.2. Let j-j &e a bounded non-negative function defined on G for each i = 
1, • • • , n and n G N. For z = (zi, - • • , z n ) G M n ; Zef i/te function ip : W 1 — > R 6e defined 



Then ip is continuous, concave and monotone increasing in each variable separately. 

Proof. Since ip is the pointwise infimum of affine functions and ri is non-negative for 
each % = 1, • • ■ , n, then it is not hard to see that ip is concave and is monotone increasing 
in each variable separately. We next show that ip is continuous, which completes the 
proof of the lemma. Fix z G W 1 and let {z m , m G N} be a sequence of points in 
R" such that z m — > z as m — > oo. By the definition of ip(z), for each e > 0, there 
exists x G G such that Y17=i r i( x ) z i < V"^) + e - Since z m — > z and rj is bounded for 
each i = 1, • • • ,n, for all m large enough, we have Y^i=i r i{ x ) z T < ip{z) + 2e. This 
shows that ip(z m ) < ip(z) + 2e for all m large enough. Thus, by taking limsup and 
then e — > 0, we have limsup,^^ ip{z m ) < ip(z). On the other hand, For each x G G, 
^{ z ) — Sr=i r i( x ) z i by definition. For each e > 0, sup^g SILi r i( a 0kf , ' — -^l < £ for all 
m large enough since r\ is bounded for each i = 1, • • ■ , n. Then ?/>(z) < ri(x)zf l +e 
for all x G G and all m large enough. It follows that ip(z) < ini xe Q (X^Li fiO^f 1 ) + £ 
for all m large enough and hence ip(z) < liminfm^oo ip(z m ). As a result, we have 
linim-s.oo ip(z m ) = ip(z) and ip is continuous at z G R n . This shows that ip is continuous. 
□ 

For each function v G Cb(G x G), define Ta(i>) as follows: 




> _^{h{y)-XCh{y),--- ,f n {y)-\CUy))dv{y). 



by 




' (ri,-" ,rn,/i,-- ,/n,5) :n€N,fi €H, ' 
G Cfc(G), inf rj(x) > 0, i = 1, ... ,n, 



(13) T A (u) = < S* G C(G), and Vx, y G G, 



> . 



n 



J]riW(/i(y) - A£/*(y)) + > 



V i=l 



Thus, it is easy to see that T^(f) is non-empty for each v £ Cb(G x G). 
For each « G Cb(G x G), define 



(14) 
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and 

(15) Q X -(v) = -Qx + (-v). 

Then the functionals Q\+ and Q\- are real- valued on Cb(G x G) and satisfy the following 
properties. We use and 1, respectively, to represent the identically zero and the 
identically one functions on G x G. Then 0, 1 G Cb(G x G). 

Proposition 5.3. For each v, v\, v 2 G C&(G x G), t > and C,C\,C 2 G R, 

(1) Qa+(0) > 0; 

(2) Q A +(^i + u 2 ) < Qa+0>i) + Qa+(^) and Q\+(tv) = tQ x+ (v); 

(3) Qx-(v)<Qx+(v); 

(4) Q A _(C1) = Q A+ (C1) = C; 

(5) < v 2 , then Q A +(«l) < Qa+(«2) and Qa-(^i) < Qa-^); 

(6) if dl <v< C 2 1, then C x < Q X -(v) < Qx+(v) < C 2 . 

Proof. We start with the proof of the first property. For each n G N, let 

(n,--- ,r n ,fl,"- ,fn,S) G T A (0). 
It follows from Lemma 15.21 that the function ip : R n — > R defined by 

ip(zi,--- ,z n ) = inf_ y^ri{x)zi 

is continuous, concave and monotone increasing in each variable separately. For each 
a > 0, let <f) a : R n -> R be a function (mollifier) that satisfies </> a G C°°(R n ), 

4>a > 0, supp(0 a ) C B a (0) C R n , / a (x) dx = 1. 

Letting * stand for the convolution operation, we define 

i(; a = ip * </> Q . 

Then G C°°(R n ) and is also concave and monotone increasing in each variable 
separately. It follows from Lemma 15.11 that 



_r(h(y),--- Jn(y))d7T(y) 

> f_r(fi(y)-^h(y),--- Jn(y)-XCh(y))d7r(y). 
Jg 



Since f\ G C% (G) © R for each i = 1, • • • , n and ip a ip pointwise as a — > 0, by sending 
a — > and applying the dominated convergence theorem to both sides of the above 
inequality, we have 



(16) 



/ inf ( Vri^/id/) J dir(y) 

> [ mf ( Vr i (x)(/ ?; (y)-A£/ l (y)) ] 
JgxcG \^ J 



dn(y). 



G 
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Thus, for every (r±, • ■ • , r n , /i, • • ■ , f n , S) £ Ta(0), n E N, using (fT6j) and the definition 
of Ta(0) given in (fT3l) . it follows that 

f>(y)/i(y) + S(y) Wy) 

,i=l / 

> J_ ^inf (j>(x)/,(y)^ + %)J d7r(y) 

> f_ ^inf ^r i (x)(/ l (y) - A£/. 4 (y))^ + S(y)^ dvr(y) 

> 0. 

Property 1 is then a consequence of the definition of Q\ + given in (HH). 

The second property follows from the definition of Q\+ in ()14[) and the observations 
that 

(r{, • • • , /?, • • • , e T\(vj) for j = 1, 2, 

imply 

(r{,... y ni ,rl,--- ,<,/!,... J^fl--- ,/^S 1 + 5 2 )GT A (« 1+? ; 2 ) 
and that 

Or, • • • ,r„,/i, • • • ,/„,£) G T A (u) 

if and only if 

(n, • • • ,r n ,t/i, • • • ,tf n ,tS) G T A (». 

Now, the definition of Qa- in (|15p and properties 1 and 2 of C/a+ just established above 
imply that 

Qx+(v) - Qx-(v) = Qx+{v) + Qx+(-v) > Q A +(0) > 0, 

which establishes the third property. 

Since (ri,f±,S) = (0,0, CI) G Ta(C1) and ir is a probability measure, it follows 
from the definition (114p of C/A+ that 

Qa+(C1) < C. 

Replacing C by — C in the last inequality and using (|15p . this implies that 

Qa-(ci) = -q a+ (-ci) > -(-c) = a 

Thus, property 4 follows from property 3 and the last two assertions. Since Ta(^2) ^ 
Y\(v\) when v\ < V2, property 5 is an immediate consequence of the definitions of 
Qx + and C/a- given in (fTl"]) and (fl"5j) . respectively. Property 6 is easily deduced from 
properties 3-5. □ 

Properties 2 and 4 of Proposition 15.31 show that Q\+ is a sublinear functional on 
C b (G x G) and C = Q\ + (Cl) = Q\-(Cl) for each Cel. Note that C fe (G x G) is 
a vector space. Let Aa be the linear functional on the space of constant functions on 
G x G defined by 

Ax(Cl) = C. 

By the Hahn-Banach theorem and the definitions of Q\+ and Q\~, A\ can be extended 
to a linear functional on C b {G x G) that satisfies 

(17) Q x - < Aa < Qx+- 
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Together with property 6 of Proposition 15.31 this implies that A A (1) = 1 and Ax is 
a positive linear functional on Cb(G x G) and hence on Cq{G x G). Thus, by the 
Riesz representation theorem and the fact that A\(C1) = C, there exists a probability 
measure v\ on G x G with 

(18) k\(y) = I v(x,y)dv\(x,y) for each v G C (G x G) R. 

JGxG 

The next lemma shows that both marginals of the probability measure v\ are equal 

to 7T. 

Lemma 5.4. For each w G C C (G), 



(19) / w(x)dux{x,y) = / w(y)du x {x,y) = _w(x)dir(x). 

JGxG JGxG Jg 

Proof. It suffices to prove (fT9|) for non-negative functions w G C C (G) with sup a , g ^u;(x) < 
1. Let {f n , n G N} be a sequence of functions in C C (G) such that < /„ < / n +i < 1 
for each n G N and f n (x) — > 1 as n — > oo for each x G G. For each n G N, set 

u n {x,y) = f n (y), v n (x,y) = w(x)f n (y), (x,y) G G x G, 

then u n , 1 — u n G C C (G x G). Set v(x,y) = w{x), (x,y) £ G x G. Since {r\,fi,S\) = 
{w, 1, 0) G T A (u) and (r 2 , / 2 , 5 2 ) = (1 - w, 1, 0) G T A (1 - «), by (HTJ), linearity of A A , 
property (5) of Proposition 15.31 and the definition (TH|) of Qa+j w e have 

(20) A x (v n ) < Qx+{v n ) < Qx+(v) < f_w{x) dTT(x) 

Jg 

and 

(21) A A (l-<) = A x (l - v) + A x (v(l - u n )) 

< Qx+(1 ~ V) + Q A +(1 " Un) 

< f_{l-w(x))dn(x)+Qx + (l-u n ). 
Jg 

The above two inequalities (f20j) and (f2T|) . together with (fT8|) and the facts that A^(l) = 
1 and tt is a probability measure, imply that 



(22) _w(x) dir(x) - Q\+(l - u n ) < / w{x)f n (y)dvx{x,y) < _w(x)dir(x). 

Jg Jgxg Jg 

Since (1, 0, 1 — f n ) G T^(l — u n ), by property (6) of Proposition 15.31 and the definition 
(fT4"|) of Qx+, we have 

0<Q A +(l-«n)< I (l-/„(x))dir(x). 



Applying the dominated convergence theorem to the right-hand side of the above in- 
equality, we have 

lim Qx+(l ~ u n ) = 0. 

n— ¥oo 

Then another application of the dominated convergence theorem to the middle term of 
(1221) yields that 

w(x)dvx(x, y) = I w(x)dir(x). 
GxG Jg 
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In an exactly analogous fashion, we can define 

v(x,y) = w(y), v n (x,y) = f n (x)w(y), (x,y) G G x G, n G N. 

Using the facts that (1,0, to) G T A (-t;) and (1,0, 1 — ■&>) G T A (1 — v), the same argument 
given above can then be used to establish the second equality in (fT9|) . This completes 
the proof of the lemma. □ 

Let {qx'°(dy), x G G} be a regular conditional probability of v\. For each bounded 
and measurable function g and x G G, define 



(23) A(g)(x) = _g(y)q x x '°(dy). 

JG 

Then for each r G C(G) with inf a;g ^r(x) > and 5 G C C (G), we have 

r(x)g(y)dv\(x,y) 



GxG 

(24) = /_ _r{x)g(y)<£'°(dy)dir(x) 

IQxG 

_r(x)7r° x (g)(x)dTr(x). 
G 

For every g G C C (G), substituting w = g in (fT9|) and r = 1 in pi"]), it follows that 

(25) / / _g(y)qt°(dy)7T(dx) = f g(y)n(dy). 

J J G x G J 

This shows that ir would serve as a stationary distribution for any Markov chain with 
qx'° as its transition kernel. However, in order to be able to show that the limit of the 
sequence of Markov chains, as A — > 0, satisfies the submartingale problem, we will need 
to establish an additional inequality. As we show below, this will require us to modify 
the definition of qx'° for x on a set of zero 7r-measure. 

Let r G C C (G) with inf^r^) > 0, g G C C (G), and -/ G U such that f(y) - 
XCf(y) < g(y) for all y G G. Defining v(x,y) = r{x)g{y) for (x,y) G G x G, we see 
that v G C C (G x G) and (r, -/,0) G T A (-u). Therefore, using first flU} and (USD, next 
(|17p and (|15p . and then the definition of Q\+ in (|14p . it follows that 



r(a;)7r5[(0)(a;)d7r(aO = A x (v) > Q x _(v) = -Qx+(-v) 

> / r(x)f(x)dir(x). 



(26) 



We now show that the function r in (|26p can be replaced by the indicator function 
of any bounded Borel measurable set. 

Lemma 5.5. Suppose we are given g G C C (G) and —f G H such that f(y) — XCf(y) < 
g{y) for all y G G. Then for each bounded Borel measurable set A, 

(27) f_l A (x)Tr° x (g)(x)dTT(x) > [_lA(x)f(x)dir(x). 

JG JG 

Proof. Fix a bounded Borel measurable set A. For the space G and the finite measure 7r, 
it follows from Lusin's theorem that there exists a sequence {r n , n G N} of continuous 
functions with compact support such that sup^gg |r n (x)| < 1 for all n G N and TLa( x ) = 
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linin-^cxj r n (x) almost everywhere with respect to tt. Since Ha is non-negative, we have 
1-a(x) = \im n - >00 (r n (x) V 0) almost everywhere with respect to tt, where r n {-) V is 
continuous and non-negative for each n G N. By (|26l) . we have for each n G N, 



_ r n (x) V 0)TT° x (g)(x)dir(x) > Jr n (x) V 0)f(x)dir(x). 
G JG 

Thus, (|27p follows from (|26p and an application of the dominated convergence theorem. 
□ 

For each g G C C (G) and y £ G, let 



(28) «A(s)(y) = sup 



f(y) : -/ G U, and for all z E G, 
f(z) - XCf(z) < g(z) 



Lemma 5.6. There exists a Borel measurable set U with tt(U) = such that for every 
9 G C C (G), 

(29) 7r° x (g)(y)>K X (g)(y), ye~G\U. 

Proof. To establish the lemma it suffices to show that for each g G C C (G), 

(30) [_l A (y)7T x (g)(y)dir(y) > f_\ A (y)K X (g)(y)d^(y) 
JG JG 

for every measurable subset A of G. Indeed, then fix a countable dense subset {g n ,n G 
N} in C C {G). For each n G N, the inequality (|5U|) applied with g = g n implies that there 
exists a Borel measurable set U gn such that vr([/ gii ) = and ir x (g n )(y) > n x (g n )(y) for 
all y G G \ f/ Sri . If we set U = U ne ^Ug n , then ir(U) = and 

(31) A{9n)(y) > K\{9n){y), n€n,y£G\U. 

We now extend this inequality to all g G C C {G) by a standard approximation argument. 
Fix g G C C (G) and y £ G \ U. Since g G C C {G) and {g n -,n G N} is a countable dense 
set of C C (G), there exists a subsequence {<7 nfc , k G N} of {g n ,n G N} such that g nfe — > g 
uniformly as k — > oo. Let = sup zg ^ |g nfe (2:) — g(z)\ for each /c G N. For each — / G H 
and f(z) — XCf(z) < g(z) for all z G G, and for each A; G N, let fk = f — Then 
— /fc G H and for each z £ G, 

f k (z) - XCf k (z) = f(z) - XCf(z) -e k < g(z) - e k < g nk {z). 

Thus by (f3TI) we have for each k G N, 

n\(gn k )(y) > K X (g nk )(y) > fk(y) = f(y)-e k . 

By taking the limit as k — > oo on both sides of the above inequality, we obtain (I29D . 

It remains to show ()30p . Fix g G C C (G), and let m g denote the supremum of g on G. 
From (f23j) . it is clear that n ( l(g)(y) < m g for each y £ G. Suppose that ([30]) does not 
hold. Then there exist e > and a bounded Borel set ACG such that n(A) > and 
for each y G A, 

7r x (g)(y) < Kx (g)(y) - e. 

Let M 9jj 4 be the essential supremum of K\(g) on A under it. Then it follows from the 
definition of the essential supremum that 

tt(A n {y G G : K X (g)(y) > M g>A - e/4}) > 0. 
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Notice that the definition of n\(g) implies that n\(g) is lower semicontinuous, and then 
the set {y G G : K\(g)(y) > M 9t A — e/4} is an open set. Since any open set in M J 
is the union of an increasing sequence of closed sets and A is bounded, then there 
exists a closed set D such that D is a subset of {y G G : n x {g){y) > M g> A — ^/4} and 
tt(A n D) > 0. We claim that there exists y G D such that tt(A n B r (y)) > for each 
r > 0. Indeed, suppose the claim does not hold. In other words, suppose that for every 
y G D, there exists r y > such that 7r(A n B r (y)) = 0. Then, since D is compact, by 
applying a finite cover argument, it follows that ir(Ar)D) = 0, which is a contradiction. 
Hence, the claim holds. Now, choose y G D that satisfies the properties of the claim, 
and note that then K\(g)(y) > M 9) a — e/4. By the definition of n x (g)(y), there exists 
a function / G C%(G) such that -/ G H, f(z) - XCf(z) < g(z) for all z G G and 
/(y) > K\(g)(y) — e/4. Hence, it follows that f(y) > M 9i a — e/2. By the continuity 
of /, there exists r% > such that /(z) > M g a — 3e/4 for all z G ^4 n B Tl (y). As a 
consequence, 7r-almost surely on A n B ri (y), 

A(9)(z) < K X (g){z) -e<M g , A -e< f(z) - e/4. 

Thus, we have 

l_^AnB ri (y)(z)Tr° x (g)(z)dTT(z) < [_l A nB n ( y )(z){f(z) - e/4)dir(z). 
Jg Jg 

On the other hand, it follows from Lemma 15.51 that 

L^AnB r Ay){z)TTl{g){z)dT:{z) > _l A nB r Ay)(z)f{z)d7r(z). 
Jg Jg 

But this contradicts the previous inequality since it (A n B Tl {y)) > 0. This establishes 

(|30p and the lemma follows. □ 

Let the measurable set U be as in Lemma 15.61 and define 

(32) q^(dz)=^°(dz) and 7r x (g)(y) = 7T° x (g)(y), ye~G\U. 

We shall now extend the definition of qy to y for all y G G in such a way that the 
analogous inequality (|29p holds on all of G. Since the submartingale problem is well 
posed, let {Q z , z G G} be the unique solution to the submartingale problem. For 
each y G U, t > and Borel set ^4, let p(t,y,A) = Q y (co(t) G A); thus, p(t,y,-) is the 
probability distribution of u{t) under Q y . For y £ U and Borel set j4, define 

1 r°° 

(33) ^(A) = -J e- t / x p(t,y,A)dt 
and for each 5 G C^R" 7 ), define 

(34) vr A ( 5 )(y) = f_g{z)q x y {dz) = 1 f_e^ X E^[g(u;(t))] dt, y G [/, 

where the second equality above follows from an application of Fubini's theorem. 

Lemma 5.7. For each g G C C (G) and y £ G, ir\(g)(y) > K X (g)(y). 

Proof. For each g G C C (G), let -/ G ft be such that /(z) - A£/(z) < g{z) for all z£G. 
It follows from property 2 of Definition 12.11 that 

/(w(t))- I Cf{u{u))du 
Jo 
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is a Qy-submartingale on (C [0, oo) , At, {Mt}), which implies that 



fWt)) 



Cf{<jj{u)) du 



>E^[/(o;(0))]=/(y), 



and hence, that 



(35) 



~t/\ E Qy 



/("(*)) 



£f(u(u)) du 



dt > f(y). 



An application of Fubini's theorem shows that 



~t/X E Qy 



Cf(u{u)) du 



dt 



EQv [£/(*(«))] 



-n/A E Q s du. 



-^ x dt) du 



When combined with (|34p and (|35p this implies that 

7T X (f-XCf)(y)>f(y), yeU. 

Taking the supremum over all / that satisfy — / G % and f(z) — XCf(z) < g(z) for all 
z G G, we conclude that TT\{g){y) > K\(g)(y) for y £ G \ U. Together with (f3"2j) and 
Lemma 15, 61 this completes the proof. □ 

We are now in a position to construct the desired Markov chain. Let {X x (nX),n G 
Z + } be a discrete time Markov chain defined on some probability space (Q, J 7 , P) with 
transition kernel q%(dy). Also, let 

T x = a(X x (jX),j = 0,l,--- ,n), n G N. 

The next result shows that this Markov chain has the desired properties. 

Proposition 5.8. For each A > ; it is a stationary distribution of the Markov chain 
{X x (nX),n G Z + }. Moreover, for each y G G, g G C C (G) and f G C^(G) such that 
-f G U and g = f - XCf, 

n-l 

(36) g(X x (nX)) - g(X x (0)) - X ]T Cf(X x (jX)), n G N, 

j=o 

and 

n 

(37) f(X x (nX))-f(X x (0))-XY,^f(X X (jX)), n G N, 
are F-submartingales with respect to {J-, x }. 

Proof. For g G C C (G), substituting w = g in (fT9|) . r = 1 in (p^) . and using the relations 
qy(dz) = qy'°(dz) for y G G \ U and 7r(£7) = 0, it follows that 

E^[g(X x (X))]=E^[g(X x (0)}- 
This shows that tt is a stationary distribution of the Markov chain {X A (nA),ra G 



STATIONARY DISTRIBUTION CHARACTERIZATION 23 

To prove the second part of the lemma, fix g G C C (G) and / G C^(G) such that 
— / G % and g = f — A£/, and let I denote the identity map /(<?) = g. Then, by the 
definition of vr A given in fl52"]). ([25]) and ([gift. 

71— 1 1 

(38) 5(* A (nA)) - <?(* A (0)) - ^fa - /)( 5 )(X A (jA)) 

i=o 

is a P-martingale with respect to {J 7 ^}. By Lemma lBTTl for each z G G, 7TA(g)(z) > /(z), 
and hence (it\ — I)g(z) > XCf(z). This establishes the submartingale property for the 
process in ([36]) . In turn, since f = g + £f, this immediately implies the submartingale 
property for the process in (l37l) . □ 

5.2. Localization and Conditioning. Let {X x (nX),n G Z + } be the Markov chain 
with transition kernel {q X {dy), x G G} and initial distribution it as constructed in 
the last section, and let X x denote the continuous time extension obtained by linearly 
interpolating {X x (n\),n G Z + } between time points nX and (n + 1)A for n G Z+. Let 

jA = a(X X (nX),n< \t\), t > 0. 

Note that, by construction, X x has continuous paths. Let {X m ,m G N} be a sequence 
of positive decreasing real numbers such that X m — > as m — > oo. For each m G N, let 
Q m denote the probability measure on (C [0, oo) , .M) induced by Jf Am (-) when X Am (0) 
has distribution ir. By ([3]), (Q)^ is the integral of Q y , the solution to the submartingale 
problem for a given initial condition y, with respect to the probability measure ir. 
It will prove convenient to represent Q m in a similar fashion. For each m G N and 
lo G C [0, oo), let be a regular conditional probability distribution of Q m given M.q. 
Then, for each oj' G C [0, oo), 

(39) Q3M0)=a/(0)) = l. 

Moreover, disintegrating Q m and using the fact that the distribution of w(0) under Q m 
is 7r, we obtain 

(40) Q m (-)=/ Q$(-n m (du>')= f Q^(-)F^du'), 

JC[0,oo) JC[0,oo) 

where P 71 " is the probability measure on (C [0, oo) , .Mq) obtained as the restriction of 
Q m to Mo defined as follows: for every A Q G B(R J ), 

(41) F n (A) =vr(A nG), if A = {uj G C [0, oo) : w(0) G A)}- 

Since G may be unbounded, we now carry out a localization. For each JVgN and 
a; G C [0, oo), let 

^M=inf(i>0: * = for some iGZ + and 1 
v ' \ - ^ B N (0) J 

To ease the notation, for each N,m G N, we use Q N,m to denote the probability 
measure on (C [0, oo) , .M) induced by uj(- A n > m ). Also, for each m,iV G N, let 
Q^' m be the law of w(- A under Q™,. Then {Q^' m } is a regular conditional 

probability distribution of Q N,m given A4q. Now, for each N > recall the stopping 
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time x N defined in ([5]). It is an immediate consequence of the definitions that for each 
m,N eN, x N < K N ' Xm and hence, 

(42) Q% m (A)=Q%(A), AeM xN . 
Moreover, analogous to ([4"0|) . Q^, ,m satisfies the integral representation 

(43) Q N ' m (-) = [ ®% m (-)Q N > m (du>') = [ Q$ m (.)V"(du/). 

JC[0,oo) JC[0,oo) 

We now state two main results and show that they imply Theorem [TJ The first is a 
compactness result, which is proved in Section [5,3.2i 

Proposition 5.9. Suppose that Assumption^ holds. Then for each N G N, for each 
u' G C [0, oo), the sequence of probability measures {Q^/ m ,m G N} on the Polish space 
(C [0, oo) equipped with the uniform topology on compact sets, is precompact. 

The second result is a characterization of limit points of the sequence, and is proved 
in Section 15.4.21 

Proposition 5.10. Suppose Assumptions holds. Then there exists Fq G with 
P 7r (Fo) = such that for every N G N large enough such that V C Bn(0) and each 
w' ^ Fq, any limit point Q^'* of the sequence {Q^/ m ,m G N} satisfies 

(44) ®Z'*(A)=® U} , (0) (A), AgM xN , 

where for z G G, Q z is the unique solution to the submartingale problem with initial 
condition z. 

Proof of Theorem d To prove Theorem [H it suffices to show that the inequality ([2]) is 
sufficient for ir to be a stationary distribution for the unique solution to the associated 
submartingale problem. For each N G N, by Lemma 11.1.2 of [46] the stopping time \ N 
is lower semicontinuous and, for every oj G C [0, oo), {x (w), N G N} is a nondecreasing 
sequence that increases to oo. Due to (|42p . Proposition 15.91 and Proposition 15.101 
Lemma 11.1.1 of [46] (applied to Qj m , <Q£/m) and x N > respectively, in place of P n ' k , P n 

and r k in [36]) shows that for F n almost every a/, as m — > oo, =>■ Q w '(o)- By the 

Portmanteau theorem, this implies that for P 71 " almost every uj' and every open set 
AeM, 

liminfQ^(A)>Q^ (0) (A). 

When combined with the representations ([4]) and ()40|) for Q w and Q m , respectively, and 
Fatou's lemma, this implies that for every open set A G M, 

liminfQ m (,4) = liminf f Q^(^)P^(dw / ) 
JC[0,oo) 

= [_® z (A)K{dz)=® n (A). 
Jg 

Another application of the Portmanteau theorem then shows that, as m — > oo, Q m =>• 

Qtt- 
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Fix t > and / E Cl(G). To show that 7r is a stationary distribution of the unique 
solution to the submartingale problem, it suffices to show that 



(45) E^[/Hi))]= _f(z)7r(dz). 

Jg 

Since ir is a stationary distribution for each Markov chain, it follows that 
lim E Qm [f(w([t/X m \X m ))}= [ f(z)*(dz), 

m— >oo J-Q 

and the convergence Q m =>• Q w established above implies 



lim 

m— >oo 



0. 



[/(«,(*))] -E" [/(™(t))] 

Thus, to establish (05J), it suffices to show that for every / G C^(G), 
(46) lim E« m [|/( w (t)) - f(w([t/X m \X m ))\] = 0. 

Now, for each m G N, 5 > and p > 0, define 



if™ = <w: sup |w(f) - w(s)| < p 

I s:|i-s|<A m 



and 



-Kp,<5 = < w : sup \w(t) — oj(s)\ < p > . 

[ s:|t-s|<<5 J 

Then if™, iC p 5 are two open sets in M. and K p t g C iT™ if X m < 6. On the set K™, 

\f(u;(t)) - f(w([t/X m \X m ))\ KWf'lUp. 

On the other hand, the convergence Q m =>■ and an application of the Portmanteau 
theorem show that 

lim S upQ w (if^) <QAK C P)S ). 

in— <rco 

Since tQ^ is a probability measure on C [0, 00), then lim^o Qtt(K^ $) = 0. Putting these 
all together, we see that 



lim E® m l\f(u;(t)) - f(w(lt/X m \X m ))\] < lim 2||/|| 0O Q m ((K p m ) c ) + Wf'W^p 

< 2\\f\\ OQ Q m (K^) + H/'lUp. 

Sending <5 | 0, then p | we obtain (j46l) and, hence, (f45|) . which proves that 7r is a 
stationary distribution for the submartingale problem. □ 



5.3. Precompactness. The proof of Proposition l5.9l is given in Section l573.21 It makes 
use of a general sufficient condition for the precompactness of a sequence of probability 
measures, which is first stated in Section [5.3.11 
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5.3.1. A Sufficient Condition for Precompactness. For p > 0, let T™{p) = and for 
m G N, let 

(A7\ ^ m (n\ - ir,f / * - ^lO*) : * = 3 X rn for some j G Z + and \ 

(47) r n { p) - | |&;(t) _ w(c _ i(p)) | > p/4 j • 

Lemma 5.11. A sequence of probability measures {P m ,m G N} is precompact in the 
Prohorov topology on the Polish space (C [0, oo) , Ai) if the following conditions hold: 

(1) for any p > 0, 5 = j\ m for some j G N, and n G Z + , 

P m (C +1 ( P ) - < 6\M T rn (p) ) < 8A p/i 

P m almost surely on {t™(p) < oo}, where A p ^ is a constant depending only on 

p; 

(2) for each T > and e > 0, 
lim V P m (K(j + l)A m ) - uj(jX m )\ > e) = 0; 



0<jA m <T 



(3) 



lim supP m (|w(0)| > /) = 0. 

Z->oo mgN 



Proof. The lemma follows directly from Theorem 1.4.11 of [36]. Note that Theorem 
1.4.11 of [46! contains the additional assumption that the hypotheses 1.4.8 and 1.4.9 
(with h = h n ) and the choice of the constants Af can be made independent of n. 
However, this assumption is used only to prove Lemma 1.4.10 of |46| . Here, we put the 
result of Lemma 1.4.10 therein as one of the conditions of the lemma. □ 

5.3.2. Proof of Proposition [57P1 Fix n G N. For each x G G and e G (0,oo), let f x>£ 
be the function from the family defined in Assumption [TJ The proof consists of three 
main claims. 

Claim 1. For each to' G C[0, oo), x G G and e G (0, oo), 

(48) f X)£ (u>(\t/X m ] X m )) -f X) eW0)) -Xm Yl £fxAu(j\n)) 

is an integrable Q^,' m -supermartingale. 

Proof of Claim 1. Fix to' G C[0, oo), x G G and e G (0,oo). By the construction 
of {X Xm (i\ m ), i G Z+}, under Q m , {w(iA m ), i G Z+} is a Markov chain. Thus, 
{co(iX m ), i G Z + } is still a Markov chain under Q™,. It follows from (|37|) that for each 

/G^nc c 2 (G), 

rt/Ami 

(49) /Mft/Aml A m )) - /(w(0)) - ^ Cf(u(jX m ))X m 

3=1 

is a Q™-supermartingale. By property (1) of Assumption [I] /a, e is a finite or count- 
able sum of functions in U n C^(G). Since f x>£ G C£(G), then (08]) follows from (1391 . 
an application of L 1 convergence theorem for a sequence of supermartingales and an 
application of optional stopping theorem. 

We now show that the sequence {Q^/ m , m G N} satisfies all three conditions stated 
in Lemma 15. Ill and hence is precompact. 
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Claim 2. {Q^, ,m ,m G N} satisfies condition 1 of Lemma 15,111 

Proof of Claim 2. Fix p > and 5 > of the form 5 = kX m for some k G N, and 
m G Z+. For n, m G N, we recall the definition of the stopping time T™(p) given in 
flH|) , and let {Q^.™} and {Q™ n }, respectively, denote regular conditional probability 
distributions of Q^,' m and Q™, given M. T m,!p\. It is easy to see that 

Notice that {uj(i\ m ), i > T™(p)(ui*)/X m } is a Markov chain under {Q™. n }. The same 
argument in proving Claim 1, together with the optional stopping theorem, shows that 
for each x G G and e G (0, oo), 

(50) Q2ft(C00(«) = C&OGA = "*(*)> < t < r™(p)(u)) = 1, 
and 



(51) U,eW\(r™(p) + t)/X m ] A m )) - /«XC(p))) 

r(^(p)+t)/A m lA( K JV - A ™/A m ) 
- £fx,e(.u(jX m ))X m 
J=(r(rrW)/Aml+l)A(«^^/A ro ) 

is a Q^-supermartingale. Let x* = lj*(t™(p)(oq*)). If x* G G\ B N (0), under Qjj™, 
by the definition of K N '^ m , u{\(r™{p) +t)/X m \ X m ) is identically equal to x* for all 



t > 0. Therefore, T™ +l (p) = oo and 



niV.m , 



r m (p) < <5) = 0, where 



r m (p) = inf 



* > : T™(p)(uj*) + t = jX m for some j G . 
|«(T™(p)(«*) + t) - > p/4 



and 



On the other hand, suppose that x* G G n Bn(0). Let e = p/24. It is easy to 
see that f x *,e( x *) = £fx*,s(%*) = 0. Applying the optional stopping theorem to the 
supermartingale in (|5ip . we obtain 



E^[/, v (u;(r(C(p) +r m (p) A S)/A m ] A m ))] 

r(r™(p)+r™(p)A5)/A m lA( K JV ' A -/A m ) 



JV,m 



£/xv(w(jA m ))A 



j=(r(^(p))/A m i+i)A( K ^.^/A m ) 



By property 3 of Assumption [JJ there exists C < oo (depending only on N and p) such 
that 

su R \£f x *, £ (y)\<C. 

ydG 

By property 2 of Assumption [TJ there exists c > (depending only on N and p) such 
that 

fx*,e(v) ^ cl {|^-x*|>3e} ) for all y G G. 
Moreover, on the set {r m ( / o) < 5}, 

\u>(r™(p)(u;*) + T m (p))-x*\>p/4>3e. 

Combining the last four displays, we conclude that 



(52) 



(T m (p) < 5) < E^*. 

< CS, 



fx 



T™( P )+T m (p)A5 
Am 



A, 
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where the last inequality follows since 5 is a multiple of A m . This shows that condition 
1 of Lemma 15.111 holds with A p /^ = C/c, which is a constant depending only on p and 
N. 

Claim 3. For each T > and e > 0, 

lim V ®% m (\u((j + l)A m ) - u(jX m )\ >e) = 0. 

m— >oo * — » 

o<iA m <r 

Proof of Claim 3. For each < jX m < T, we have 
®% m (\u>((j + l)X m )-u>(jX m )\ >e) 



f.N,m 



; m + l)A m ) - Lj(jX m )\ > e\M jX J 



By replacing r m (p) by j\ m in the argument in Claim 2, for a regular conditional 

of Q^/ m given Mp 



probability distribution {Q^*™} of Q^' m given Aijx m , we have that for each x E G and 



e G (0, oo), 

(53) C*™M*) = <«>*(*)> < * < j^m) = 1, 

and 

(54) fx,e{u(\{j\m + t)/Am] A m )) - f x ,e(.u(jX m )) 

rO'A m +t)/A m lA( K JV ' A ™/A m ) 

- ^ Cf X)£ (uj(kX m ))X m 

fc=(i+i)A(«^^/A m ) 

is a Q^»™-supermartingale. Let y* = w*(j'A m ), = e/3 and e^ 2 = e/24, then 3q 2 < 
e/ 1 /2. By an argument similar to that used to derive the first inequality in (152p . there 
exists c > (depending only on e and 2V) such that 

(55) cQS™(|w((j + l)A m ) - oj(jX m )\ >e)< E [f y *,e h ( w ((j + l)A m ))]. 
On the other hand, the supermartingale property in (|54p implies that 

(56) E^[/ r , £ii ( W ((j + l)A m ))] < A m E<%/ a * j£!i (u;((j + l)A m ))]. 

By property 2 of Assumption [H Cf y *^ h (y) = for |y - y*| < e h /2 and f y *,s h {y) > 
c(N,£i 2 ) > for \y — y*\ > 3e; 2 . When combined with property 3 of Assumption [TJ it 
follows that there exists 

K N = max{C(Ar, e h )/c(N, e h ), C(N, e h )} 

such that \Cf y * tEh (y)\ < K N f y * ;£l2 (y) and \Cf y *,e h (y)\ < K N for every y G G. Together 
with (j55j) and (l5f)j) . applied first with and then with £; 2 in place of £/ x , this implies 
that 

cQ^(K(j + l)A m ) -w(jA m )| > e) < A m ^E^*.[/ ri£;2 (a;((i + l)A m ))] 



< X 2 m K N K^,[Cf r , eh (u((j + l)A m ))] 

Hence, we have 



< A 2 ?T 2 



£ Q^' m (|u;((j + l)A m ) - co(jX m )\ >e)< TK 2 N X m /c, 

0<j\ m <T 
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which converges to zero as m — > oo. This establishes condition 2 of Lemma 15.111 

Finally, (|39p shows that condition 3 of Lemma 15.111 holds automatically. Thus, 
{Q w ,' m ,m E N} satisfies all the conditions of Lemma 15 . 1 1 1 and therefore is precompact. 



5.4. Convergence of the Approximating Sequence. We now turn to the proof 
of Proposition 15.101 That any weak limit of {Q ' m ,m £ N} satisfies the first two 
properties of the submartingale problem will be deduced primarily from results already 
obtained in Section l5T3l The verification of the third property relies on some preliminary 
estimates that are first established in Section EUTj and the proof is completed in Section 

E32J 

5.4.1. Preliminary Estimates. 

Lemma 5.12. There exists a set Fq E .Mo with P 7r (Fo) = such that for each uJ E 
C[0,oo)\F , 



(57) 



lim W 

m— >-oo 



ft/As 



E 

j=0 



/Am) 



0. 



Proof. Since n is a stationary distribution for each Markov chain, the distribution of 
oj(JX m ) under Q m is equal to it for every j,m E N. Together with (|43p and (|44p this 
implies that for each t > 0, 



lim sup / E 

m->oo 7C[0,oo) 

= lim sup E^ 



< lim sup E^ 

m— too 



\t/X mk ]A(K N ^/X m ) 
Am ^ lBj_(5G) ( w (i^mfc)) 



J=0 

ft/Ami ACk^'^/Ato) 



Am 

r*/A», 



E 

i=o 



l-B^G) (j'A m )) 



X] (w(jA m )) 

• n m 



< i lim 

m— K» 



r)G 



IL B i (aG)(^) 7r (^) 



0, 



where the last equality follows from the assumption that ir(dG) = 0. Since the integrand 
in the first term above is nonnegative, this completes the proof of the lemma. □ 

The following family of test functions will be used in the proof of Theorem [TJ The 
proof relies on Assumption [2] and is purely analytic, and hence is relegated to Appendix 

Lemma 5.13. Suppose Assumption^ holds. For i£V, let v x ^ be the unit vector 
stated in Assumption^ and let h(y) = {v x ,y — x) on G. Then for each x E V, there 
exist constants c > and C > such that for all e > sufficiently small and 5 E (0, e), 
there exists a non-negative function g$ :£ E C^(G) © R with —gs, £ £ % suc/i i/iai 
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(!) sup ygS 5 5 , e (y) < Ce; 

(2) S u Vy ^\Vgs,e(y)\<Cy/E; 

(3) sup J/e5 |(6(y) : y 5(5i£ (y))| < C^e; 

(4) /or eac/i y S Gn B Tx (x) 



Ei =1 %'(y)?if# > c z/ 5 + 2v^ < My) < e/2, 



(b) >:•, 



% 3\y) dxidxj 



< C^e ifh(y)>e; 



(c) Ei=i^'(y)S^7 > Araise 



5.4.2. Proof of Proposition \ 5.1fl[ Let Fq be as in Lemma 15.121 Fix u' £ Fq, and let 
Q^,'* be a weak limit of a convergent subsequence {Q^' mfc , k G N} in {Q^ m ,m G N}. 
It suffices to show that Q^' * satisfies the three properties of the submartingale problem 
stopped at \ N with initial condition u/(0) (see Definition ^. 4p . The first property follows 
directly from (|39|) . Also, by Proposition 15.81 f° r each fc G N, for every / G C^(G) such 
that -/ G 



(58) 



/(wflt/Am*! A m J) - A mfc £ Cf(u(l\ mk )) 



i=i 



is a Q^,' mfc -submartingale. Since Q^,' mk 



j , a standard convergence argument 
together with an application of the optional stopping theorem shows that for every 
/ G C 2 C (G) such that -fen, 



t/\x' 



/MiA X JV ))- / Cf(u(s))ds 
Jo 



is a Q^,'*-submartingale, which establishes the second property of the local submartin- 
gale problem. 

We now turn to the proof of the third property. Fix x G V. Let the constants C, c, 
the function h and, for each e > sufficiently small and 5 G (0,e), the function gg s be 
the associated quantities from Lemma 15.131 Since g§ £ is a nonnegative function that 
lies in C%(G), Proposition 15.81 with / replaced by gs :£ , and property 1 of Lemma \5. 131 
show that 



>m fe 



\thK N ' Xm k /\ mk 

£95,£{u(l\ mk )) 



l=i 



[g S)£ (oj(\t/X mk -\ X mk ))]-g s>£ (u:'(0)) < Ce. 
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Substituting the definition of the operator £ in ([T]), and then using property 2 of Lemma 
15.131 this implies that 



E " 



JV,m fc 



(59) 



[tAK JV '' Am VAm fc ] 



£ E «x*a™J) dxidxj 



1=1 ij=l 



< 2Ce - 2E l 



ltAK N ' Xm k /A„ 



*m fc 



E (K^(^m fe )),V Wie (u;(/A m J)) 



< 2C£ + 2C\/i(i + A mjfe ) 



For each k G N, using properties 4(a), 4(b) and 4(c) of Lemma T5.13I and then ([59]) . we 
have 



cE^ 



JV,m fc 



| _ MK iv ' Am fc/A mfe j 

E 1 Br a; (x)( w (^ m J)l ((5+2v ^ ie/2) (/l(w(/A mfe ))) 



< E v , 



< E , 



N,m k 



>m fc 



|"tAK iV ' Xm fe/A mfe ] J 

E E a ^{l\m k )) 

1=1 i,j=l 

\tAK N ' Xm k/\ mk j j 



9 2 gS,e( UJ ( lX rn k )) 

dxidxj 



l m {h(u(lX mk ))) 



X ™ k E E %'( W A mJ)- - Af . ., ( . ; 



i=l ij=l 

< 2C£ + 3C v / i(t + A mfc ). 
Taking limits as 5 \. in the last display, we obtain 

\tAK N ' Xm k/\ mk j 



e^; 



N,m k 



E IL B I . a: (ao(w(/A mfe ))l (0i£/ 2)(/i(w(ZA m J)) 



2=1 



C 



< -(2e + 3v^(t + A mfe )). 

Since, on B rx (x), h(y) = if and only if y = x and x G V C <9G, combining the above 
inequality with Lemma 15.121 we obtain 



lim 

k— >oo 



c 



\t/\ mk ]A(K N ' Xm k/X mk ) 



E lB ri (,)(w(W m J)l[ 0i£ /2)(/l(w('A m J)) 



Z=l 



< - (2e + 3^) 
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Notice that 

n N ' m k 



<E^ 



< W 



o 

N,m k 



^B rx (x) (M[ s / A ml A m ))l[0, e /2) OM PV A ml A m )))ds 

%B rx (x) (uj{\s/\ m ] A m ))l[ 0)E /2) (/i(w([s/A m ] A m )))rfs 

rt/A mfc ]A(« jr,ATO fc/A mfc ) 



>m fe 



E 

z=i 



11 



B, 



(a .) (W (ZA m J ) 1 [0)£/2 ) (l\ m J)) 



where the first inequality follows from the fact that under Q ! mk , h(u(t)) > e/2 when 



t > K N,Xm k and ui(t) G B Tx (x) and the second inequality follows the fact that the 
integrand is non-negative. Let / G C(R) be such that < / < l(_ £ /2,e/2) an d /(0) = 1 
and let g G C(R J ) be such that < g < ^b Tx and g(x) = 1. Since /i is non-negative, 
we have 



E " 



Since Q^, ,mk =4> Q^/* as &: — )• oo, by applying the Skorokhod representation theorem 
and Lemma A. 4 of |30| to the left-hand side of the above inequality and using the fact 
that h(y) = if and only if y = x and y G B Tx {x), we conclude that 



N,m k 



(gf)(h(u(\s/X m ]X m )))ds 



< E^ 



o 

JV,m fc 



1 



/if 



. (x) (w([s/A m ] A m ))l[ 0)£ / 2 ) [s/A m ] A m )))ds 



.AT,* 



*AX J 



l{x}(w(s))<fa 



< i (2Ce + 2Cy/et) . 



Sending first e — > on the right-hand side of the above inequality and then t — > oo, we 
have 



E 



^{x}(u(s))ds 



0. 



Because there are only a finite number of x G V, summing the above over x G V shows 
that <Q>/* also satisfies the third property in Definition 12.41 with initial condition z = 
u/(0). Since, for each A'GN, the unique solution to the local submartingale problem 
stopped at \ N coincides on M. x n with the unique solution Q z to the submartingale 
problem with the same initial condition, this completes the proof of the proposition. □ 

6. Proof of Theorem [2] 

Since Assumption [2] follows directly from Assumption 2', the proof of Theorem [2] 
essentially reduces to the construction of a test function that satisfies Assumption 
[TJ This construction involves patching together certain local test functions, whose 
existence is first established in Proposition 16.11 The proof of Proposition 16.11 is purely 
analytic, and is thus relegated to Appendix lAl 

Proposition 6.1. Suppose (G,d(-)) is piecewise C 1 with continuous reflection and V C 
dG satisfies Assumption 2'. Then for every x G G and e > 0, there exists a nonegative 
function g% G H n C^(G) such that 
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(1) S up P [^]nGC B £ (x)nG; 

(2) there exists an open neighbourhood X)£ of x such that 

9 e x {y) > j f° r aU V G °x,e-i 

(3) there exists a constant A(x, s) > such that 

sup|fl£(v)l < A(sc,e), sup|Vg£(y)| < A[x,e) 

yeG y&G 



sup 



< A(x,e). 



Moreover, when (G,d(-)) is a polyhedral domain with piecewise constant reflection, for 
every 5 > i/iere exists an open neighborhood 00 5 e and a constant A($,6, e) such 
that Xj£ = 0<ft s e and A(x,e) = A(0, 5, e) for each x G G \ Ns(dG) and for every 
x G dG\Ns(VUU i ^x(x)(9Gr\dGi)), there exists a finite collection of open neighborhoods 
and constants {Op ; s,£i A{F,5,s) : F G {F(z) 
and A(x,e) = A(l(x),5, s). 



z edG\ V}} such that Xj£ = X ( X ),5, £ 



We now use Proposition 16.11 to prove Theorem [2l Suppose first that (G, d(-)) is 
piecewise C 1 with continuous reflection and G is bounded. Fix e > and JVgN. Let 
the family of functions g x and associated sets X)£ , x G G, be as in Proposition 16.11 
For each z G G, the set Gfl {x G R : |x — z| > 2e} is compact. Therefore there exists 
a finite set 

Sz = { x j £ C, |xj — z\ > 2s, j = 1, • • ■ , /} 

such that 

(60) 0« J>e DGn{x£R J : \x - z\ > 2s}. 
Now, for each z G G, define 

(61) K( y )= 9 £ Xj (y), y^G. 

Now, since G n Bn(0) is compact, there exists a finite cover of G n Bn(0) of the form 
{Be/2{ z k)i z k £ G n -Bat(O), fc = 1, • • • , mjv}. For each x G G n Bn(0), if x is contained 
in B £ /2i z k) f° r only one fc, then define / X)£ = h £ z , and if x is contained in J3 e /2(z/fe) for 
more than one A;, define /a; )£ = fa| „ where k* is the smallest index among those fc's. 

We now verify that the functions {f Xj£ ,x £ Cfl Bn(0),s > 0} satisfy the properties 
stated in Assumption [TJ Since each g £ x lies in H. C\C%(G) by Proposition 16.11 it follows 
that each h e z , and therefore each f x>£ , is a finite sum of functions in %, and the first 
property follows. Now, fix x G G R Bn(0) and let be such that \z^ — x\ < s/2 
and f Xi£ = h £ . Note that \y — x\ > 3s implies \y — Zf~\ > 2s, which in turn implies 
that y G U x . e gN O x . £ due to (j60j) . The definition (jBTT) of M , the fact that each g x . 
is nonnegative and property 2 of Proposition 16.11 then imply that h £ Zk {y) > 1/2. On 
the other hand, suppose \y — x\ < s/2. Then \y — Zf.\ < s. However, the inequalities 
\xj — Zk\ > 2s and supp^ .] C B £ {x) (with the latter inequality resulting from property 
1 of Proposition 16. ip for all xj G S z imply that h Zk (y) = for \y — zy\ < s. Thus, we 
have shown that f x>£ satisfies property 2 of Assumption[TJ Lastly, since each g e x G C^(G) 
and b and a are continuous, there exists C X;£ < 00 such that \Cg x (y)\ < C Xj£ for every 
y G G. Thus, if we set C(N , e) — max/j = i v .. jmjv ^2 x ^s z G x ,ei h is clear that f x>£ satisfies 
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property 3 of Assumption [Vj This completes the proof of Theorem [2] for the case of a 
bounded domain. 

Next, suppose that (G,d(-)) is a polyhedral domain with piecewise constant reflec- 
tion. Since G is a polyhedron and the set V is finite, it follows from the second part 
of Proposition 16. II that there exist a constant integer m(z,e) > 0, a constant C Z)£ < oo 
and a countable set 

S z = {xj £ G : \xj - z\> 2e,j £ N} 

such that 

(62) U XjeSz Xji£ D Gn {x £ R J : \x-z\> 2e}, 

for each x £ G such that \x—z\ > 2e, there are at most m(z,e) open sets in {0 Xj)5 : Xj £ 
S z } that contain x, and swp x eSz \Cg x .(y)\ < C z , £ for every y £ G. Thus, we can define 
the function h £ z as in (|61j) for each z £ G and follow the previous argument for the case 
when {G, d(-)) is piecewise C 1 with continuous reflection and G is bounded to complete 
the proof of Theorem [2] with c(N,s) = 1/2 and C(N,e) = vaaxk=l,...,m N m(zk, e)C Zk>e . 
□ 

Appendix A. Construction of Local Test Functions 

This section is devoted to the proof of Proposition 16.11 Consider (G,d(-)) that are 
piecewise C 1 with continuous reflection. We first construct a family of test functions 
g Xj r, for x £ G and sufficiently small r > 0. The nature of the construction is different 
for the cases x £ G, x £ dG \ V or x £ V, and is presented below in Propositions 
IA.ll IA.4I and IA.61 respectively. The proof of Proposition 16.11 is given at the end of the 
section. 

Proposition A.l. For each x £ G, there is a constant A x < oo such that for every 
r £ (0, r x ), where r x = (dist(x, dG)) 2 , there exists a nonnegative function g x>r £ C^(G) 
such that 

(1) supp[g x>r ] nGc B^(x) C G; 

(2) < g X) r(y) < 1 for all y £ R J and g X) r(y) = 1 for each y £ B^ /2 (x); 

(3) the following bounds are satisfied: 



sup \g x , r {y)\ < Ax, sup \Vg x , r (y)\ < —, sup 

yeG y&G r y&G 



J 

E 



d 2 g x ,r(y) 



dyidyj 



A x 



Proof. Let ^ be a bounded C°° function on R such that = 1 when z < 1/2, £(z) = 
when z > 1, and £ is strictly decreasing in the interval (1/2,1), and note that then 
||£'||oo < °o and ||£"||oo < oo- For each x £ G and < r < r x , define g x>r (y) = 
£(\y — x\ 2 /r) for y £ M J . The three properties of g X)T are then easily verified. The first 
inclusion in the first property holds because \x — y\ 2 /r > 1 when y B ^(x) and £(z) = 
when z > 1, whereas the second inclusion holds because y^r < = dist(x, dG). The 
second property is satisfied because y £ B ^p/2(%) implies (y—x) 2 /r < 1/4, and £(z) = 1 
for z < 1/4, and the last property holds with A x = max(l, 2||^ / [| DO dist(a;, dG), (4(J 2 — 

j)iiriioo + 2j|ie / iu) (di S t(x,dG)) 2 ). □ 

Remark A. 2. The function g x ^ r in Proposition lA.ll is translation invariant in G in the 
sense that g x , r (y) = 9x+5,r(y + 8) for each y £ Bc(x) and r < r x A r^. 
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We now paraphrase a result from [35] that will be used to construct local functions 
associated with points x G dG. 

Lemma A. 3. Let C be a closed convex cone with vertex at the origin and a boundary 
that is C°° , except possibly at the vertex. Given any closed, convex, compact subset K, 
of the interior of C, constants < r] < A < oo and e > 0, there exists a C°° function I 
on the set 

A = {y G M J : rj < dist(y,C) < A} 
that satisfies the following properties: 

(1) su PzeA (\£(z) - dist(>,C)| V \Vl{z) - 1|) < e; 



d 2 l(z) 
dzjdzk 



< * + 1. 

V 



(2) for every j, k G {1, . . . , J}, sup 2eA 

(3) there exists 6 > such that 

(V£(z),p) < -9, forpeIC and z G A. 

On the other hand, if C is a half-space so that its boundary is C°° everywhere, given 
any subset K. of C, the function £(x) = dist(x,C) ; x G A ; is a C 2 function on A that 
satisfies properties (1) and (2) above and property (3) with 6 = 0. 

As shown in |35j, a function i with the properties stated above can be constructed as 
a suitable mollification of the distance function to the cone C. Indeed, Lemma IA.3I 
follows immediately from the proof of Lemma 6.2 of [35], with gc, Lc,s c , K£ , fjc, 
Ac and £c therein replaced by /(•), C, IC, rj, A and e, respectively. 

We now construct the second class of test functions associated with x G V. 

Proposition A. 4. Suppose Assumption 2' holds with unit vector v x and associated 
constants r x > 0, < c x < c\ < oo, a x > 0, x G V. For each x G V there is a 
constant A x < oo such that for every r G (0, r x /c x ), there exists a nonnegative function 
g X)T G C 2 (G) such that the following three properties hold: 

(1) supp[g x , r ] nGc B c 2 r (x) DGcB rx (x) n G; 

(2) 9x,r(y) = 1 for each y G B c i r (x) n G; 

(3) the following bounds are satisfied: 

A x ^ 

sup \g x , r (y)\ < A x , sup \Vg x , r (y)\ < —, sup 2^ 

yeG y£G T y£Gij =1 

(4) (d,Vg x , r (y)) <0forde d(y) and y G dG. 
Proof. Fix x G V and r G (0,r x /c x ). By ([9]) of Assumption 2', we have 

sup dist(y, x + rv x +@ x ) = sup dist(y, x + rv x + <d x ) 

y eGnB rx {x) y&GnB c 2 r {x) 

(63) < sup \y — x — rv x \ < (c x + l)r. 

yeGnB 2 (x) 

We first argue by contradiction to establish the claim that the quantity 

x)/r,v x + Q x ) 



d 2 g x ,r(y) 



dyidyj 



< 



A x 



is strictly positive. 



= inf _ inf dist((y - 

re(0,r x /cl) yeG: \y-x\/r<<^ 

Suppose, instead, that n x = 0. 



Then there exists a sequence 



{{yr, 



: m G N} such that for each m G N, r m G (0, r x /c x ), y m G G, \y m —x\/r ri 



<4 



36 WEINING KANG AND KAVITA RAMANAN 

and dist((y TO — x)/r m ,v x + X ) — > as m — > oo. Since (y m — x)/r m is bounded by c x 
uniformly in m, by choosing a subsequence if necessary, we may assume without loss of 
generality that there exists y* such that \y*\ < c x and (y m — x)/r m — > y* as m — > oo. 
This implies that dist(y*,v x + Q x ) = or, in other words, that y* = v x + z* for some 
z* G Q x . Thus, since v x is a unit vector and z* G 0Z implies (v x , z*) > 0, 

|y*| 2 = (v x + z*,v x + z*) = l + 2(v x ,z*) + \z*\ 2 > 1. 

But this contradicts the inequalities \y*\ < c x < 1. Thus, we have shown that k^. > 0. 
Since Q x is a half-plane that goes through the origin, this implies that 

(64) dist(y, x + rv x + Q x ) > K x r for each y G G n B c \ r {x). 

Consider the set 

A x = {z G R J : || < dist(z, e x ) < c x + 3} , 

and define £ x (z) = dist(^, & x ) for z G A x . Then, since Q x is a half-space and property 
2 of Assumption 2' shows that U^ g ^ nBj ( x \d(y) Q & x , it follows from Lemma [A..3I that 

4 satisfies properties (l)-(3) therein with A = A x , C = Q x , K, = U^ g ^ nBr ( x \d(y), 
V = k-x/32, A = c x + 3, e = k x /64 and = 0. Now, let £ be a C°° function defined on 
R such that £(s) = when s < 1/2, £(s) = 1 when s > 1, and £ is strictly increasing 
in the interval (1/2, 1). Then, for each y G R J , define 

5x,r(y) = 



otherwise. 



The first property of £ x from Lemma lA.31 and the definition of £ imply that 

supp^nG C {y€GnB rx (x): l l (t^)>f} 

C {i/eGfl S rx (x) : dist(y, x + + 6«) > 

However, by the property Q of c x stated in Assumption 2' and the fact that rc x < r x , 
it follows that 

{y G GnB r . x (x) : dist(y,x + rv x + 6 a .) > K x r/8} C Gnfi^fi). 

The last two assertions and (|63|) together imply that supp[g Xjr .] n G C A^. This and 
the fact that ( G C°°(R) and 4 G C 00 ^) imply that g x>r is C~(M J ). The last two 
assertions also imply that g x r satisfies the first property stated in the proposition. 
Next, for y G G n B c i r (x), by ([Ml) it follows that dist( y-*-™* , 9^) > and by the 
first property of 4 from Lemma lA.31 we have £ x ( y ~ x ~ TVx ) > 63^/64, which in turn 

implies C (£4 C" 1 ;"' )) = L Thus ' ^,r(y) = 1 for all y G Gn6 c i r (i), showing 
that the second property holds. The third property is easily verified using the form of 
g Xi r, the fact that g x ^ r G C%°(G). Finally, the fourth property of g XjT holds because I 
satisfies the third property of Lemma lA.31 with 9 = 0, and £ is non-decreasing. □ 



We now turn to the construction of local test functions associated with x G dG \ V. 
For this, we first introduce some geometric objects associated with the directions of 
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reflection, similar to those introduced in Section 6.1 of [35] in the context of polyhedral 
domains. For x G dG, let 

(65) K x = < - ^2 a n\ x ) '■ a i > 0,i G Z(x), ^ Qj = 

[ ieZ(x) ieZ(a;) 

Note that -ftT x is a convex, compact subset of M J . Therefore, there exist ^ > and a 
compact, convex set i^a;^ such that K Xi $ x has C°° boundary and satisfies 

(66) ^ /2 C(%)°C%C^, 

where we recall that denotes the e-fattening of the set K x for every e > 0. Now, if 
x G \ VcW, then it is easy to see that G" and 

(67) min (n l (x), d) < for every d G iCr. 

ieZ(a;) 

Therefore, 5 X > can be chosen such that ^ K x g x and 

(68) min (n l (x),d) < for every 
»er(x) 

We first establish an elementary result that will be used in the construction. 
Lemma A. 5. For x G dG \ V, there exist R x G (0, 1) and f3 x > such that 

(69) min (n l (x),d) < -2/3 x \d\ for every d G Ute[0,IU tK x,8 x 
iex(x) 

and 

(70) (x + U te[0)Rx] tK XjSx ) nG = {x}. 

Moreover, if n l (-) and r y l {-) are constant vector fields for each i G I, then R x and 5 X 
depend on x only through I(x). 

Proof. We first use an argument by contradiction to prove that 

(71) sup min (n^x), < 0. 

Suppose ([7T]) does not hold. Then there exists a sequence {d n , n > 1} C K x ^ x such 
that min ig 2:( a ;)(n 4 (x), d n /\d n \) > for all n > 1. Since i^s,^ is compact, by choosing a 
subsequence if necessary, we may assume without loss of generality that d n — )• d G K X) g x 
as n — )• oo. Thus, minjgj^) (n J (x) , ci/|d|) > 0, which contradicts (j68|) . Thus, (fTTj) holds 
and, in turn, this implies that there exists f3 x > such that (|69p holds. 

On the other hand, for each i G I(x), since <9Gj is C 1 near x, it follows that 

lim _ inf min (n l (x), (y — x)/|y — x|) > 0. 
S^-OyeG: \y-x\<8 ieX(x) 

Together with (|71j) this shows that there exists R x G (0, 1) such that 

y — x d 

(72) inf min (n J (x), , r) > sup min (n*(x), t— -s). 

y eG: [»-*[<fl.(Ei6i(.) IrWI+fe) *ez(x) | y - x| de^, fe <ei(*) \d\ 

We now use this to prove ([TO]) by contradiction. Suppose that (|70|) does not hold. Then 
there exists d G ^te[o,R x ]tK Xt s x such that cf / and x + d G G. Since d G U^ro^ii-K^, 
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there is t* < R x and d* G K X) $ X such that d = t*d* and \d\ < Rx(Y^iex(x) l7*( x )l + fix)- 
Then (I72p implies that 

min {n l (x), d* f\ d* |) = min (n l (x), d/|d|) > sup min (n*(x), d/|d|), 
iGX(x) iGX(x) deK x<Sx iel(x) 

which contradicts the fact that d* G K x ^ x . 

The last statement in the lemma follows directly from the constancy of n l (-), i El, 
and the fact that K X) g x and 5 X can be chosen to depend on x only through Z(x) in this 
case. □ 

For each i G T(x), since dGi is C 1 near x G SG, the hyperplane {y G M J : (n l (x),y — 
x) = 0} is the tangent plane to <9Gj at x for each i G I(x). Let 

(73) 5 X = n iex(x) {y G M J : (n\x), y - x) > 0}. 

Then G can be locally approximated near x by the polyhedral cone S x in the sense 
that for each N > 0, 

(74) {x + {y - x)/r G R J : y G G, |y - x| < Nr} -»■ S x D Bjv(s) as r -»■ 0, 

where the convergence is under the Hausdorff distance. In view of ()70p . it follows that 
there exist < r x < dist(x, V U { Ji^x(x)(9G H dGi)) and A x G (0, 1) such that for each 
r G (0,^), 

(75) {y G M J : dist(y,x + U t <^^, 5 J < 3A x r} n dG C S r (ar) D dG 
and 

(76) {y£R J : dist(y,x + U i <^^ i5 J<3A ;E r}nGna J B r (x) = 0. 
Let L Xi s x be a truncated (half) cone with vertex at the origin defined by 

( 77 ) L x,5 x = U t < Rx / 2 tK X! S x . 
Then (|7QJ) implies 

(i + L, )fc )nG = {i}. 

Proposition A. 6. For each x G <9G \ V, there exist < r x < dist(x, V U U^xtx) (9G D 
dGi)), A x G (0, oo), and a family of nonnegative functions {g x , r G C%(G) : r G (0, r x ]} 
i/iai satisfy the following additional properties: 

(1) s?w[ 5x . ir ] nGcB, (x) n G; 

(2) g x<r {y) = 1 /or eac/i y G Bg xr (x) n G /or some constant 5 XiT > 0; 

(3) /or r G (0,^), 



J 



sup |fe,r(y)| < At, sup|V5f a;ir (y)| < — , sup ^ 



d 2 g x ,r(y) 



dyidyj 



(4) (d,Vg x ,r(y)) < /or all d G d(y) and y G <9G. 

Proof. Fix x G <9G \ V. Let q x be a unit vector in the set K x defined in (i65|) such that 
— q x points into G from x, and for each r G (0, 1), define 

R 

(78) M(x, r) = x - \ x -^-rq x + rL I)fc 

and 

M 2A * r (x,r) = {y G M J : dist(y, M(x, r)) < 2X x r}. 
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2\ x ri 



:-!!) 



Recalling R x < 1, it is easy to see that for each y G M 
dist(y,x + U t <R x tK X)Sx ) < 2X x r + 

Thus, 



[x, r 



R x 



< 3A T r. 



M 2X * r (x,r) C {y G M J : dist(y, x + U t <^t^ 5 J < 3A x r} 
and hence, by ([75]) — ([76]) we have 

M 2A * r (x, r) n G n &B r (a:) = 0, 

and 



(79) 



M 



(x,r) nGc S r (x) n G. 



It follows from Lemma lA.31 with C = Ut>otK x ^ x , K. = K x , A = 1\ x , rj = rj x G 
(0,A X ), A = A I = {t/eM J : r? x < dist (y, U t > tK XjSm ) < 2X X } and ^ = X x /12 A 7^/2 
that there exists a function £ x : A x — > M, that satisfies all the properties stated in 
Lemma lA.31 Let 

(80) 0(x,r) = Gn(M Mir (i,r)\M v (i,r)) cB r {x)nG. 

Note that by the local approximation of G by S x at x in (TT3]) . by possibly making r s 
and A x smaller, we may assume that for each r G (0, r x ) and y G 0(x, r), that is, y G G 
such that 



(81) 



i] x < dist 



— \~ ^x—^-Qx, L x $ x j _ 2\ , . 



the projection of (y — x)/r + X x (R x /2)q x to Ae,^ coincides with the projection of 
(y-x)/r+X x (R x /2)q x onto U^otfCr,^ since L Xj s x is the portion of U t >otK Xy s x truncated 
near the vertex. Let k xr be the function on 0(x,r) given by 

R, 



(82) 



y-x 



+ X x — q x 



ye 



Then the properties of l x stated in Lemma [A.3I and (j80|) imply that A^j. G C°°(0(x,r)) 
and fe^ satisfies the following additional properties: 

(1) there exists 6 X > such that 

{Vk X)J . (y) ,p) < -9 x /r for p G K%' /3 and y G 0(x, r); 

(2) for every i,j G {!,-•• , J}, 



sup 

j/SO(a:,r) 



<9 2 fer,r (y) 



dyiVj 



r/ x . y r A 



(3) sup ye0(a!)f .)(|A; a . )r (y)-dist((j/-x)/r + A a; (jR a; /2)g a .,L a;j( 5 !1 .)| V (r| VA;^ (y)| - 1)) < 
Ax/12. 

From the first property of k x>r stated above, it follows that 

(rVk Xtr (y),j l (x)) > 6 X for i G I(x) and y G 0(x,r). 

Since 7*(-) is continuous for each i G X, by possibly making r x yet smaller and using 
the third property of k Xtr , we may assume that for each r G (0, r x ), 

(83) (rVk x , r (y),Y{y)} > x /2 for i G I(y) and y G 0(x,r). 
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Now, choose Q x G C°°(M) to be a decreasing function such that 

[ 1 if s G (-00,5^/4], 

(84) (^.(s) = ^ strictly decreasing if s G (5X X /A, 23A X /12], 

I if s G (23A x /12,oo), 

and define g x r : M> J — > M + to be 

{Cx(kx,r(y)) ifyG 0(x,r), 
1 j£y€GnM^ r (x,r), 
otherwise. 

It follows from the definition of g x ,r, the properties of £ x and k xr , t ne definitions of 
M(x,r) and 0(x,r) given in ((75]) and ((50]) . respectively, and property ((79]) that 

s^PPbx/r] n G 

C jy G G : < 23 J§ 

r- r ^ 7=? ^- + /y _a; , r "\ ^ 23Aa; , 

C 1/ £ G : dist q x , L r x < \ 

(86) ltf \ r 2 ' V ~ 12 12 ; 

y G G : dist ( y - x + g rq x ,rL xSx ) < 2X x r 



= M 2X * T (x,r)C\G 
C B r (x)nG. 

This establishes property (1) of the lemma. In addition, 

{y G G : ^, r (y) > 5A,/4} 
(87) C |y G G : dist ( — + — fel^ j > — - - 

C jy G G : dist((y - x) + ^-^rq x ,rL xfix ) > X x r 

Thus, the set on which y X)J . is not constant is a strict subset of 0(x,r). Combining 
this with ([SB]) and the properties ( x G C°°(R) and fc^r G C°°(0(x,r)), it follows that 
<fe, r GC°°(G). 

Since x is an interior point of M(x,r), there exists 5 x , r > such that Bx xr {x) C 
M(x,r). For y G B$ xr (x), property 3 of k XjT implies k x , r (y) < X x /12, which when 
combined with ((55]) and ((53]) . implies g X) r(y) = 1- Thus, y^,. satisfies property 2 of the 
lemma. On the other hand, g x<r satisfies property 3 because of (|85p and properties 2 
and 3 of k XjT . Finally, for each y G 0(x,r), a simple calculation shows that 

Vy x ,r(y) = C x {k x , r {y))Vk Xir (y). 

Together with (|83j) and the fact that £ x is non-increasing, this implies that 

(Vy x/r (y),7 i (y)) < for i G Z(y) and y G 0(x,r). 

Thus, g Xir also satisfies the fourth property stated in the lemma. □ 

Corollary A. 7. If n l {-) and 7*(-) are constant vector fields for each i G X ; i/ien i/ie 
constants A x G (0, 00) and r x > in Proposition \A.6\ can be chosen to satisfy A x = 
A x i and r x = r x > if l(x) = I(x'), r x < dist(x,V U { Ji^x(x)(dG n dGi)) and r x > < 
dist(x', V U Ui^z(x')(dG n dGi)). Moreover, the family of nonnegative functions {g X) r G 
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Cc(G) : r £ (0,r x ]} in Proposition \A.6\ is translation invariant in the sense that 
9x,r(y) = 9x+S,r(y + 5) ifZ(x) = I(x') and r x = r x >. 

Proof. Suppose that n l {-) and 7*(-) are constant vector fields for each i € I. Notice 
that the sets K x and K x g x and the constant 5 X can be chosen to depend on x only 
through X(x). Similarly, the constants R x and j3 x in Lemma lA.5] and hence the set 
Lx,8 x m ([77]) . depend on x only through X(x). It is obvious that G = S x near x and S x 
depends on x only through X(x). In addition, the constant X x £ (0, 1) in ([75]) and ([76]) 
depends on x only through X{x) and r x in ([75]) and ([76]) depends on x only through 
when r x < dist(x,VUU i ^x(x)(dGr\dGi)). Also, notice that by the proof of Lemma 
6.2 of [35], the constants e x £ (0, 1), r\ x > 0, the set A x and the function 4, depend 
on x only through X{x). By examining the proof of Proposition IA.6[ we see that the 
vector q x , the set M(x,r) in ([78]) . the set O x>r in ([80]) and the function £ x depend on x 
only through X{x). This establishes the corollary. □ 

Proof of Proposition [b\l[ Set r(x, e) = ((r x /2) A e) / max(c^,l) for x £ G and e > 0. 
Now, for x £ G and x £ dG\V, let 

9 X — 9x,r(x,e) be the corresponding functions in (G) 
constructed in Propositions IA.1I and IA.61 respectively, and for x £ V, let g Xtr r E > be as 
constructed in Proposition I A. 41 Note that the first property established in Proposition 
I A. II shows that when x £ G, g%{y) = for y £ dG. Together with the finiteness of V, 
the second property of Proposition IA.4[ the definition of r x for x £ dG \ V, and the 
first property of Proposition IA.61 this shows that g% is constant in a neighborhood of 
V. On the other hand, when combined with the first property of Proposition IA.1I and 
the fourth properties of Propositions IA.4 I and IA.61 it shows that (d,Vg x (y)) < for 
d £ d(y) and y £ dG. Thus, g% £ rl. In addition, the choice of r(e) and the first two 
properties of {g X}r (e)i x e established in Propositions IA. 1\ IA.4I and IA.61 immediately 
imply that {g x ,x £ G} satisfies the first two properties stated in Proposition 16.11 The 
second part of the proposition follows directly from Remark IA.2I and Corollary I A. 71 □ 

Appendix B. Verification of Assumption [TJ for Example 14.51 

In this section we show that Assumption [1] holds for the two-dimensional domain 
G with a cusp at the origin described in Example 14.51 The argument relies on the 
construction of a family of functions {g Xjr £ C%{G) ■ r £ (0, r^), x £ G} that is similar 
to the family constructed in Appendix [A] Once again, the nature of the construction 
is different, depending on whether x £ G, x £ dG \ V or x £ V. For x £ G, let 
{gx,r G Cc(G) '■ r £ (0, r x )} be the family of functions constructed in Proposition lA.il 
Now, clearly (G,d(-)) is piecewise C 1 with continuous reflection and, as discussed in 
Example 14.51 Assumption 2' is satisfied with V = {0}. Therefore, there exists a family 
of functions {go, r ,r £ (0> r o/ccj)} that satisfy the properties stated in Proposition IA. 41 

It remains to consider x £ dG \ V . We first consider the case x £ dG\ \ {0}. As x 
moves to the right along dG\ to infinity, the curvature of dG\ tends to 0. In other words, 
the larger |x| is, the flatter dG\ is in any neighbourhood of x £ dG 1 . The angle between 
n 1 (x) and 7 1 (x) is fixed and is equal to 6\ £ (— tt/2, vr/2). Let K x = {— 7 1 (x)}. Then 
|7 1 (x)| = 1/ cos(#i) because (n 1 ^), 7 1 (x)) = 1. By the geometry of dG\ and Lemma 
IA.51 there exist 5 > 0, R £ (0, 1) and (3 > (all depending only on dG 1 and 0\) 
such that with K X) s = B$(— 7 1 (x)), (|69l) and ([70]) hold with 5 X and fi x replaced by 5 
and /3, respectively. Under the local coordinates at x (i.e., taking the tangent line to 
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dG\ as the x-axis and — n l (x) as the y-axis), the set x + Ut<RtK x $ is identical for 
each x G dG\ \ {0}. Thus, it follows that there exist f G (0,1) and A G (0,1) (both 
depending only on dG l and 9\) such that for each r G (0,f), (j75j) and (i76j) hold with 
5 X , R x and Aa; replaced by S, R and A, respectively. Let L X) s be a truncated (half) cone 
with vertex at the origin defined by 

Thus, {x + L Xj g) n G = {x} and is identical under the local coordinates at x 
for each x G <9Gi \ {0}. For any e G (0, 1) and < ?? < 2A < oo, it follows from 
Lemma [Ql with C = U t > tK X: s, K, = B &/ ^{-^ l (x)) and A = A x = {y G R J : r? < 
dist (y, Uj>ot-ftr x ,(5) < 2A} that there exists a function £ x : A x — > M, that satisfies all the 
properties stated in Lemma lA.31 Notice that i x and A^. are identical under the local 
coordinates at x for each x G dG\ \ {0} and by (|69l) . in property (3) of t x depends 
only on dG l and 9\. Then, using an argument similar to that used in the proof of 
Proposition IA.61 there exist < r x < dist(x, c^G^) and A G (0,oo) and a family of 
functions {g X)T G C^(G) : r G (0, r^]} satisfying all the properties in Proposition IA.61 
Here, for each x\,X2 G dG\ \ {0} and r < r Xl A r X2 , g xliT and g X2iT are identical under 
the local coordinates at x\ and X2, respectively. By symmetry, a family of functions 
{dx,r G Cj:(G) : r G (0, r x ], x G dG2 \ {0}} that satisfy analogous properties can also 
be established. Using the family of functions {g XiT G C^(G) : r G (0,r x ], x G G}, 
we can follow a similar argument as the one in the proof of Theorem [2] for the case 
when (G,d(-)) is a polyhedral domain with piecewise constant reflection to establish 
Assumption CD 



Appendix C. Proof of Lemma I5TT1 

Let 

e(A)= / [V(/i(y)-A£/ 1 (y),--- ,/ n ( y )-A£/ 1 (y))-V(/i(y),--- *r(y). 

JG 

Since tp is concave, it is clear that the map A i— > £(A) is also concave. To prove the 
lemma, we need to show that £(A) < 0. In turn, to establish this, it suffices to show 
that £'(0) < because £ is concave and £(0) = 0. 

Now, tp G C^(G) and for i = 1, . . . , n, fi G 7i implies fi G C^(G). Thus, the function 
= ip(fi(-),--- , fn{-)) lies in C^(G). In addition, since ijj is monotone increasing 
in each variable separately, and fi G % for each i = 1, . . . ,n, it follows that for each 
y G dG and d G d(y), 

(d, v*( y )> = E(^H • • • > )) v ^)) ^ °- 

Moreover, since fi £ H implies is constant in a neighborhood of V, it follows that ^ 
is also constant in a neighborhood of V. Since fi G % also implies that /j is constant 
outside some compact set, it follows that is also constant outside some compact set. 
These show that Vl> G T~L and therefore, by ([2]), that 

/ £*(y)dvr(y) > 0. 
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Now, 



'G Ki=1 

Thus, if we can show that for each y E G, 



E ^ • • • , AGO) Af*(y) > £*(y), 

1=1 

it follows that £'(0) < 0. In the rest of the proof, we establish 
Fix y 6 G. A straightforward calculation shows that 

J n 

cm = E%)Ef (/ife),-,/n(i/))|(!/) 

2=1 fc=l k 1 



1 J / n 

+2 E E 

i,i=l \k,l=l 
i,j=l \k=l k 

E^(/i(y).--- ,uv))mv) 

1=1 



^ (y) 



dxidxj 



l J / n 

+2 E My) E 

i,i=l \fc,/=l 



^(/l( y ),---,/n( y ))g( y )^(y) 



Hence, to establish (1881) it suffices to show that 



E-«W^E^CAM,-,/.W)^M^M|<o. 

Since the matrix a(y) is positive semidefinite, let a 1//2 (y) be its positive semidefinite 
square root. Then, we have 

dfh, M 



>,,]=! J 



T 



a 1/2 (y)Vf k (y)j (a^iy^My) 
J 

Vc fc c z 

/ j ^"rrv~"t 



m=l 
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where c k = a 1 / 2 (y)V fk(y) for each k = 1, - ■ ■ , n. Now, we can see that 

= E ^ (*(¥)'••• (£Mv)§£(v)||(v) 

fc,i=i ft 4 \i,i=i 

= E ( E (A(y). ■■■./»(»)) ^4 ) <o, 

m=l \fc,l=l aZfcOZ ' / 

where the last inequality holds because the Hessian matrix of ^ is negative semidefinite 
since if) is concave. □ 



Appendix D. Proof of Lemma I5.13I 



Fix x G V. By Assumption [2] there exist positive constants r x , c x ,a x that satisfy 
h(y) > c x \y—x\, {v x ,a(y)v x ) > a x and (v x , d) > for all d G d(y) and all y G Gn5 rj ,(a;). 
Let £q E (0,r x ) be such that Eq is less than the distance between any two points in V. 
For each e 6 (0, 1) such that 2(e + yfe) < c x £q and 5 E (0, e) sufficiently small such that 
5 + V6 < e, let Is e he a function such that 



r o 

3VS 



iis<S, 

if 5 < s < 5 + VS, 
if 5 + VS < s < e, 



if e < s < e + v^i, 



25(^ + 1) + s 2 - (6 + v^) 2 
25(^ + 1) - (5 + \/5) 2 + e 2 

+e 3/2_^ (s _ e _^ )2 

k 25(V5 + l)-(J + ^) 2 + e 2 + e 3 / 2 ife + ^<«- 

It is easy to verify that 

< ls,s(s) < 5e, < fy B (s) < 2^e, for s£l, 
^, e (' s ) = ' fors>e + Ve- 

Also, note that lg £ E C 1 (M) is piecewise differentiable with derivative 

( if s < <5, 

if<5<s<<5 + ^, 

= { 2 if<5 + V5<s<e, 

—2-^ if e < s < e + a/e, 

if e + ^/e < s. 

We now use a standard mollifcation argument to construct a C 2 (M) function with 
similar properties. Let {(ft n E C£°(M),ra G N} be a sequence of non-negative functions 
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with J R 4> n (x) dx = 1 and compact supports that shrink to {0}. Define 



l S,e = <t>n* k,e, 

where * denotes the convolution operation. Then I'g E C z c 
large, there exist K n > with lim^^oo K n = such that 

woo > 2 
m t£ ns)\<2^ 

(90) (Z£ e )"( S ) = _ 

qjs) = 25(V5 + 1) - (5 + ^) 2 + e 2 + e 3 / 2 if s > 2(e + ^) 

otherwise. 



and for n sufficiently 



if 5 + 2^ < s < e/2, 
if s > e — K n 
if s > 2(e + v/e) 



Now, choose n sufficiently large and let 



55, e (y) = 



if y E GnB r .(x) 
if y€5\S ra (x). 



We now show that gs, £ has the desired properties. Firstly, since h t£ (s) = when 
s < 6, it follows that is zero in a neighborhood of x. In addition, the second 
property in (|89|) . the fact that e + y^e < c x Eq and /i(y) > c x |y — x\ imply that g$ i£ is 
constant when y E G\ B £0 (x). By the choice of this implies that g$ ;£ is constant in 
a neighborhood of V. Also, by the nonnegativity of <j) n and lg e as well as the property 
of v x stated in Assumption [21 it follows that for every y E <9G, 



I'sAHv) ~ z)cf) n (z)dz ) (v x , d) > 0, d E d(y). 



iy as ^ y ),d) 



Thus, gs :£ E C 2 (G) © K and — y<s )£ E %. In addition, the first property in ([89]) shows 
that sup g g |g5 j£ (y)| < 5e and sup g ^ | (y) | < 2y/e, while the second property in 
flS§D implies that 

K%) ) V5* >e (l/))|<2 A /i sup |6(y)|, y E G. 

\y-x\<2eo 

Next, note that 



d 2 gs,e{v) 



(lt £ )"{h{y))v T x a{y)v x . 



dxidxj 

The first property in (|90p and the definition of implies that 
J q2. 



d 2 gs,e(y) 
dxidxj 



> 2a x , H5 + 2V5 < h(y) < e/2,y E GnB Tx (x). 



Moreover, by the second and third properties in (I90D . and the fact that e + y/e < c x £q 
it is clear that for each y E G n B Tx (x) with /i(y) > e — K n , 



d 2 gs,e{y) 



dxjdxj 



<|(Z^)"(%))||a(y)|<2v^ sup |a(y)|. 

|i/-x|<2e 
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The fourth property in ([90]) shows that when y E G fl B Tx (x) with < £ + 2\/5 or 
e/2 < h(y) < e - K n , 

1,3=1 ■> 

Thus, we have shown that that properties 1-6 hold with c = 2 min^gy ot x and 

C = 5V2 sup (\a(y)\ V \b(y)\) < oo. 

|j/-x|<2£ 
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